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many  comparative  analysis  problems,  providing  explanations  suitable  for  use 
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ative  analysis  question.  Although  exaggeration  does  occasionally  produce 
misleading  answers,  it  solves  a  larger  class  of  problems  than  DQ  analysis  and 
frequently  results  in  simpler  explanations. 


Theories  of  Comparative  Analysis 

by 

Daniel  Sabey  Weld 


Submitted  to  the  Department  of  Electrical  Engineering  and  Computer 

Science 

on  May  11,  1988  in  partial  fulfillment  of  the 
requirements  for  the  degree  of  Doctor  of  Philosophy  in 
Artificial  Intelligence 


ABSTRACT 

Comparative  analysis  is  the  problem  of  predicting  how  a  system  will  react 
to  perturbations  in  its  parameters,  and  why.  For  example,  comparative  analy¬ 
sis  could  be  asked  to  explain  why  the  period  of  an  oscillating  spring/ block  sys¬ 
tem  would  increase  if  the  mass  of  the  block  were  larger.  This  thesis  formalizes 
the  task  of  comparative  analysis  and  presents  two  solution  techniques:  dif¬ 
ferential  qualitative  (DQ)  analysis  and  exaggeration.  Both  techniques  solve 
many  comparative  analysis  problems,  providing  explanations  suitable  for  use 
by  design  systems,  automated  diagnosis,  intelligent  tutoring  systems,  and 
explanation  based  generalization. 

This  thesis  explains  the  theoretical  basis  for  each  technique,  describes 
how  they  are  implemented,  and  discusses  the  difference  between  the  two.  , 
DQ  analysis  is  sound;  it  never  generates  an  incorrect  answer  to  a  compar-  / 
ative  analysis  question.  Although  exaggeration  does  occasionally  produce  V 
misleading  answers,  it  solves  a  larger  class  of  problems  than  DQ  analysis  and 
frequently  results  in  simpler  explanations.  ■  ^ 

~~  Accession  I 

NT IS  GRA£] 

.  _  _  _  DTIC  TAB 

Thesis  Supervisor:  Tomas  Loz&no-Perez  Unrinnou’-c^c 

Title:  Associate  Professor  of  Computer  Science  and  Engineering  Jug t  if  icati 


COPY 

'NSPECTEO  j 


I  By - - - 

j  Distribut i on/ 

Availability  Codes 
1  {Avail  and/or 

Dist  Special 


a 


v.  TV.7V.  Vi  V.  VI V. 


ACKNOWLEDGMENTS1 

The  fellowship,  advice,  arguments  and  inspiration  I  received  while  work¬ 
ing  on  my  thesis  made  the  experience  one  to  be  thankful  for.  It  is  but  a 
small  exaggeration  to  say  that  without  this  support  the  work  would  have 
taken  infinitely  longer  and  been  infinitessimally  interesting. 

Tomas  Lozano- Perez,  my  supervisor,  was  a  major  inspiration;  I  hope  I 
can  develop  his  taste  and  judgement  in  research.  The  rest  of  my  committee 
was  equally  helpful.  Johan  de  Kleer’s  sharp  imagination  and  blunt  criti¬ 
cism  taught  me  what  was  important  about  qualitative  physics.  Randy  Davis 
helped  me  distinguish  important  themes  from  mechanisms  and  taught  me 
how  to  explain.  Patrick  Winston  showed  me  how  to  present  my  work;  now  I 
have  to  practice. 

Ken  Forbus  introduced  me  to  qualitative  physics  and  gave  many  useful 
suggestions.  Pat  Hayes  made  research  fun  and  was  always  game  for  a  fierce 
argument.  Ernie  Davis  made  many  helpful  suggestions,  including  a  proof  of 
proposition  14  and  substantial  contributions  to  the  proofs  of  proposition  20 
and  17.  David  McAllester  helped  prove  proposition  3.  Ben  Kuipers  provided 
QSIM,  facilitating  both  my  theories  and  implementations.  Most  important 
was  the  comradery  close  to  home;  Mark  Shirley  and  Brian  Williams  were 
exceptional  companions  and  critics  who  endured  my  ramblings  and  taught 
me  much. 

Both  the  broad  directions  and  technical  details  of  my  work  were  influenced 
by  discussions  with  and  comments  from  Marty  Tennenbaum,  Narinder  Singh, 
Jeff  Shrager,  Paul  Resnick,  John  Mohammed,  Jerry  Roylance,  Mike  Lowry, 
Glenn  Kramer,  Dan  Huttenlocher,  Paul  Horwitz,  Walter  Hamscher,  Jay  Free¬ 
man,  Gary  Drescher,  Dave  Chapman,  Dan  Carnese,  John  Seely  Brown,  Harry 
Barrow,  Steve  Bagley,  and  Phil  Agre.  Certain  students  (names  withheld  to 
protect  the  guilty)  spent  countless  hours  patching  facilities  and  negotiating 
contracts;  we  are  all  in  their  debt.  The  HT,  7AI  and  girlscouts  define  my 
memories  of  MIT.  Thanks  to  all  my  friends;  I  will  miss  you. 

Margaret,  fortunately,  I  need  not  miss;  you  gave  me  the  reason  to  finish. 

^his  report  describes  research  done  at  the  Artificial  Intelligence  Laboratory  of  the 
Massachusetts  Institute  of  Technology.  Support  for  the  laboratory’s  Artificial  Intelligence 
research  is  provided  in  part  by  the  Advanced  Research  Projects  Agency  of  the  Department 
of  Defense  under  Office  of  Naval  Research  contract  N00014-85-K-0124.  Portions  of  this 
research  were  done  at  Xerox  Palo  Alto  Research  Center  and  at  Schlumberger  CAS  Palo 
Alto  Research. 


»Ji  },»  »> 


**J\-  AViiJiVaViVLi; ».«  <.4'  i  Vj  t<u,l.iLA.i'lUit.»,*.>  tj  *1.  it.  V.  i».‘i>.  a"- 


Contents 


Introduction 


Thesis .  3 

Reader’s  Guide .  3 

Why  Qualitative  Physics? .  4 

Why  Comparative  Analysis? .  6 

Differential  Qualitative  Analysis .  7 

1.5.1  Perspectives .  7 

1.5.2  Changes  in  Behavioral  Topology .  11 

Exaggeration  .  12 

1.6.1  Transform,  Simulate,  and  Scale  Phases .  13 

1.6.2  Qualitative  Hyperreal  Representation .  15 

1.6.3  Persistence  and  Arrival  Filtering .  17 

Conclusions .  19 


Differential  Qualitative  Analysis  21 

2.1  Preliminaries  . 21 

2.1.1  Qualitative  Behavior . 22 

2.1.2  Comparing  Two  Behaviors . 24 

2.1.3  Comparing  Two  Behaviors  over  Intervals . 25 

2.1.4  Time  as  a  Perspective  . 27 

2.2  DQ  Inference  Rules .  28 


Duration  Rule . 29 

Derivative  Rules  .  32 

Perspective  Rules .  35 

Constants .  36 

Rules  with  Time  as  a  Perspective .  36 


Vi,*' 

•y.v 


EMM 

I'M 


I 

& 


pi 

m 

•Mw! 


y 

V 


V 


2.2.6  Rules  from  Qualitative  Arithmetic .  37 

2.3  Implementation .  37 

2.4  Extensions  for  Diagnosis . 41 

2.5  Changes  in  Behavioral  Topology . 42 

2.5.1  Initial  Behavior  Inconsistent . 46 

2.5.2  Finding  Other  Consistent  Behaviors .  50 

Exaggeration  53 

3.1  Qualitative  Representation  Extensions  . 54 

3.1.1  The  Hyperreal  Numbers .  55 

3.1.2  The  Qualitative  Hyperreals  . 56 

3.1.3  Behaviors  over  Hyperreal  Time . 59 

3.2  Transform  Phase . 59 

3.2.1  Choice  of  Parameter . 60 

3.2.2  Choice  of  Direction .  61 

3.2.3  Choice  of  Distance . 63 

3.3  Simulate  Phase . 65 

3.3.1  How  QSIM  Works .  65 

3.3.2  Transition  Tables . 68 

3.3.3  Constraint  Filters .  75 

3.3.4  Predecessor-Persistence  Filter .  77 

3.3.5  Successor- Arrival  Filter . 82 

3.3.6  Improving  the  Temporal  Filters . 86 

3.3.7  Irrelevant-Transition  Filter . 90 

3.3.8  Summary .  91 

3.4  Scale  Phase .  92 

3.4.1  Scaling  Durations . 94 

3.4.2  Multiple  Behaviors . 95 

3.5  Summary  . 96 

Analysis  of  Techniques  98 

4.1  Similarities  and  Shared  Problems . 98 

4.1.1  Ambiguous  Questions . 98 

4.1.2  Qualitative  Arithmetic  is  Ambiguous .  99 

4.1.3  Linearity  is  not  Represented . 101 

4.2  Theoretical  Difference  . 103 

4.2.1  Predicting  Partial  Derivatives . 103 


vi 


4.2.2  Predicting  Asymptotes . 

4.3  Competence  Difference . 

4.3.1  Weaknesses  of  Exaggeration . 

4.3.2  Weaknesses  of  DQ  Analysis . 

4.4  Performance  Difference . 

4.4.1  DQ  Analysis  is  Polynomial . 

4.4.2  Exaggeration  is  Exponential . 

4.5  Explanation  Difference . 

4.5.1  What  Makes  a  Good  Explanation? . 

4.5.2  Exaggeration  can  Produce  Simpler  Answers  . 

4.5.3  Unnatural  Explanations . 

4.6  Combining  the  Techniques . 

5  Related  Work 

5.1  Sensitivity  Analysis . 

5.2  Williams’  Temporal  Representation . 

5.3  de  Kleer’s  IQ  Analysis . 

5.4  Forbus’  DQ  Analysis . 

5.5  Raiman’s  FOG . 

5.6  Kuipers’  Time  Scale  Abstraction  . 

5.7  Davis’  CHEPACHET . 

5.7.1  Algorithm  Differences . 

5.7.2  Qualitative  Representation . 

6  Conclusions 

6.1  Summary  . 

6.2  Future  Work . 

6.2.1  Augmenting  DQ  Analysis  . 

6.2.2  Other  Uses  for  Exaggeration . 

6.2.3  Reasoning  about  Discontinuous  Systems  .  .  . 

6.2.4  Reasoning  with  Multiple  Models . 

6.2.5  Mixed  Qualitative  Quantitative  Reasoning  .  . 

6.3  Conclusions . 


A  Glossary 
B  A  Useful  Example 


C  Readings  in  Nonstandard  Analysis  144 

D  HR-QSIM  Transition  Tables  145 

E  Program  Output  for  the  Spring  and  Block  149 

E.l  Model  of  the  System . 149 

E.2  DQ  Analysis  Output . 150 

E.3  Exaggeration  Output . 154 

F  List  of  Examples  Implemented  157 


vui 


List  of  Figures 


1.1  Ideal  Spring  Attached  to  Block  on  Frictionless  Table  .  2 

1.2  Overview  of  the  DQ  Analysis  Algorithm  .  8 

1.3  QSIM  Behavior  for  Stable  Spring  Oscillation .  9 

1.4  Actual  Plot  of  Force  versus  Time .  10 

1.5  Hot  Oil  Flows  Through  Heat  Exchanger .  12 

1.6  Initial  Behavior  of  Heat  Exchanger .  13 

1.7  Perturbed  Behavior  of  Heat  Exchanger .  14 

1.8  Overview  of  the  Exaggeration  Algorithm .  15 

1.9  Some  Values  in  the  Heat  Hyperreal  Quantity  Space .  16 

2.1  PitfcDyeiPW^andP^ .  32 

2.2  Propositions  Are  Encoded  Directly  Into  ARK  Rules . 38 

2.3  CA  Generated  Explanation  for  Spring  with  Heavier  Block  ...  40 

2.4  Overview  of  the  DQ  Analysis  Algorithm . 43 

2.5  QSIM  State  Tree  Generates  Possible  Behaviors . 44 

2.6  Initial  Behavior  Corresponding  to  Path  (QSl,  QS2,  QS3)  ...  45 

2.7  The  Behavior  Corresponding  to  Path  (QSl,  QS2,  QS5,  QS6, 

QS7) .  47 

3.1  Overview  of  the  Exaggeration  Algorithm .  54 

3.2  Regular  and  Counter  Flow  Heat  Exchangers . 60 

3.3  Transform  Phase  Output . 63 

3.4  A  Boiler .  64 

3.5  Transitions  among  Standard  (QSIM)  Qualitative  Values  ....  70 

3.6  QSIM  Transition  for  ( li,std ) .  70 

3.7  Transitions  among  Qualitative  Hyperreal  Values .  72 

3.8  Hyperreal  Transitions  from  (Ij,  std) .  73 

3.9  Hyperreal  Transitions  from  ((HALO  0 -f),(mc  ne<//))  73 


ix 


•"•OV* 


3.10  The  Difference  Between  Peristence  and  Arrival  Times .  7 8 

3.11  The  Distance- Rate-Time  Table  .  81 

3.12  Behavior  of  a  Standard  Heat  Exchanger  .  1)2 

3.13  Behavior  of  an  Infinite  Flow  Rate  Heat  Exchanger .  1)3 

3.14  Temporal  Addition .  1)4 

4.1  Exaggeration  Approximates  a  Curve  with  a  Line  through  an 

Asymptote  . 104 

4.2  Nonmonotonic  Systems  can  Fool  Exaggeration . 107 

4.3  Equilibrium  State  for  Pumped  Containers  . 100 


Chapter  1 
Introduction 


The  problem  of  symbolic  analysis  of  real-world  systems  is  central  to  many 
problems  in  artificial  intelligence.  For  example,  robots  that  can  interact  with 
a  changing  world,  programs  that  can  design  electronic  circuits,  and  systems 
that  aid  in  medical  diagnosis  all  need  a  comprehensive  understanding  of  their 
environment.  They  must  be  able  to  analyze  their  surroundings  and  evaluate 
the  effects  of  their  actions.  Qualitative  representations  are  often  appropriate 
for  this  analysis  because  they  suppress  irrelevant  detail  and  concentrate  on 
the  fundamental  processes  that  are  present.  For  example,  rather  than  repre¬ 
senting  the  pressure  of  water  in  a  pipe  by  a  real  number,  it  is  often  sufficient 
to  know  its  ordinal  relation  to  important  landmark  values  like  the  pressure 
that  will  cause  the  pipe  to  rupture. 

Recently,  considerable  emphasis  has  been  put  on  a  specific  kind  of  anal¬ 
ysis:  qualitative  simulation[8,16,49,27,44].  Qualitative  simulation  seeks  to 
produce  a  description  of  the  behavior  of  a  system  over  time,  often  in  the 
form  of  a  tree  of  histories  of  the  system’s  qualitatively  interesting  changes 
over  time  [45]. 

This  thesis  discusses  the  problem  of  comparative  analysis,  a  task  that  is 
the  complement  of  qualitative  simulation.  Whereas  qualitative  simulation 
takes  a  structural  description  of  a  system  and  predicts  its  behavior,  compar¬ 
ative  analysis  takes  as  input  this  behavior  and  a  perturbation  and  outputs 
a  description  of  how  and  why  the  behavior  would  change  as  a  result  of  the 
perturbation. 

For  example,  given  an  ideal  spring  attached  to  a  block  on  a  frictionless 


1 


table  (figure  1.1),  a  qualitative  simulator  would  say  that  the  block  would  first 
move  one  direction,  then  stop,  then  reverse,  etc.  A  description  of  oscillation 
would  result.  Comparative  analysis,  on  the  other  hand,  takes  this  description 
of  oscillation  and  evaluates  the  effects  of  perturbations.  For  example,  it 
would  deduce  that  the  period  would  lengthen  if  the  mass  of  the  block  were 
increased,  and  explain  why.  Just  as  qualitative  simulation  works  without 
explicit  equations  for  the  value  of  each  parameter  as  a  function  of  time, 
comparative  analysis  does  not  need  a  formula  for  the  period  of  oscillation. 


Figure  1.1:  Ideal  Spring  Attached  to  Block  on  Frictionless  Table 

The  importance  of  the  qualitative  approach  to  comparative  analysis  is 
the  resulting  explanation  of  why  the  behavior  changes.  If  it  weren’t  for 
the  explanation,  one  might  simply  solve  a  differential  equation  model  us¬ 
ing  symbolic  or  numeric  techniques.  This  thesis  presents  two  techniques  for 
solving  comparative  analysis  problems:  differential  qualitative  (DQ)  analysis 
and  exaggeration.  Both  techniques  have  been  implemented  and  have  a  solid 
theoretical  foundations,  yet  they  perform  differently  and  generate  different 
kinds  of  explanations.  For  example,  DQ  analysis  would  explain  that  the 
block  would  have  a  longer  period  if  the  mass  were  increased  as  follows: 

Since  force  is  inversely  proportional  to  position,  the  force  on 
the  block  will  remain  the  same  when  the  mass  is  increased.  But 
if  the  block  is  heavier,  then  it  won’t  accelerate  as  fast.  So  it 
will  always  be  moving  slower.  Thus  the  block  will  take  longer  to 
complete  a  full  period  (assuming  it  travels  the  same  distance). 


Exaggeration  answers  the  same  question  in  a  completely  different  manner: 

If  the  mass  were  infinite,  then  the  block  would  hardly  budge. 

Thus  the  period  would  be  infinite.  So  increasing  the  mass  even  a 
smaller  amount  should  cause  the  period  to  increase  as  well. 

This  thesis  explores  the  differences  and  relative  advantages  of  the  two 
approaches. 

1.1  Thesis 

The  basic  conclusions  of  the  thesis  are  the  following: 

Differential  qualitative  analysis  and  exaggeration  are  com¬ 
plementary  techniques  for  comparative  analysis.  DQ  analysis 
is  sound  while  exaggeration  can  make  false  predictions  on  two 
classes  of  questions.  However,  exaggeration  solves  a  wider  vari 
ety  of  problems  than  does  DQ  analysis.  Together,  they  reinforce 
each  other  and  solve  many  comparative  analysis  problems. 

This  thesis  is  argued  by  a  description  of  each  technique,  by  empirical  tests 
using  computer  implementations,  and  by  a  theoretical  analysis  explaining 
why  they  perform  differently. 

1.2  Reader’s  Guide 

The  rest  of  this  introduction  gives  an  overview  of  the  thesis.  Sections  1.3 
and  1.4  are  motivational;  they  explain  why  qualitative  physics  is  interest¬ 
ing  in  the  context  of  AI,  and  why  comparative  analysis  is  interesting  in  the 
context  of  qualitative  physics.  Then  section  1.5  introduces  the  main  points 
of  DQ  analysis:  perspectives,  inference  rules  using  relative  change  values, 
and  changes  in  behavioral  topology.  The  next  section  discusses  the  second 
solution  technique,  exaggeration,  and  explains  how  it  is  composed  of  three 
phases:  transform,  simulate,  and  scale.  Finally,  section  1.7  summarizes  the 
similarities  and  differences  in  the  two  approaches  and  suggests  a  hybrid  ar¬ 
chitecture  that  takes  best  advantage  of  the  strengths  of  each  technique. 


The  rest  of  the  thesis  presents  the  details  of  the  two  comparative  analysis 
theories.  Chapter  2  explains  DQ  analysis  starting  with  a  formal  definition 
of  relative  change  and  perspectives.  Next  these  concepts  are  used  to  specify 
numerous  inference  rules,  all  of  which  are  proven  sound.  These  inference 
rules  are  the  essence  of  DQ  analysis.  The  chapter  explains  how  a  simple 
constraint  propagator  applies  the  rules  in  forward-chaining  fashion  to  solve 
numerous  comparative  analysis  problems. 

Chapter  3  presents  the  details  of  exaggeration  starting  with  the  extended, 
qualitative  hyperreal  representation  used  to  describe  systems  with  exagger¬ 
ated  perturbations  (like  the  block  with  infinite  mass).  The  chapter  describes 
all  three  phases  of  the  exaggeration  algorithm:  transform,  simulate,  and  scale, 
but  the  emphasis  is  on  the  simulate  phase  due  to  the  technical  difficulty  of 
simulation  using  the  qualitative  hyperreal  representation. 

Chapter  4  analyzes  the  DQ  and  exaggeration  techniques  by  comparing 
them  along  several  dimensions.  Unlike  the  previous  chapters  which  may  be 
read  independently  after  finishing  the  introduction,  chapter  4  is  best  appreci¬ 
ated  after  completing  previous  chapters;  see  [41]  for  a  self  contained  analysis. 
Chapter  5  is  a  discussion  of  related  work,  and  chapter  6  concludes  the  thesis 
with  a  summary  and  suggestions  for  future  research. 

Unfortunately,  the  technical  portions  of  this  thesis  contain  a  consider¬ 
able  amount  of  mathematical  definitions  and  jargon.  To  ease  this  burden  on 
the  reader,  appendix  A  contains  a  glossary  for  quick  reference.  Appendix 
E  contains  the  actual  input  and  sample  runs  of  the  DQ  analysis  and  exag¬ 
geration  programs.  Appendix  F  records  the  performance  of  the  DQ  analysis 
and  exaggeration  implementations  on  more  than  fifty  comparative  analysis 
problems. 

1.3  Why  Qualitative  Physics? 

The  goal  of  qualitative  physics  is  to  make  explicit  the  unspoken  intuition  of 
experts  in  the  physical  sciences.  I  distinguish  qualitative  physics  from  the 
field  of  naive  physics.  Qualitative  physics  is  interested  in  expert  reasoning  not 
in  duplicating  the  common  mistakes  of  novices.  Qualitative  physics  may  also 
be  distinguished  from  other  research  on  common  sense  reasoning.  Although 
qualitative  physics  deductions  indeed  seem  like  common  sense  to  those  who 
perform  them,  the  techniques  are  not  obvious.  Most  people  do  not  correctly 


solve  qualitative  physics  problems  without  some  training. 

Although  physics  and  engineering  classes  concentrate  on  teaching  tech¬ 
niques  for  manipulating  and  solving  equations,  considerable  expertise  is  nec¬ 
essary  to  correctly  choose  appropriate  equations  to  solve  in  the  first  place. 
Decisions  regarding  appropriate  quantitative  models  of  a  system  are  fre¬ 
quently  based  on  qualitative  information  and  analysis,  such  as  a  qualitative 
expectation  of  the  system’s  behavior  over  time.  In  fact  many  physics  prob¬ 
lems  can  be  solved  by  strictly  qualitative  means.  If  a  problem  specification 
is  lacking  complete  numerical  information,  then  qualitative  physics  may  be 
the  only  method  for  obtaining  an  answer.  If  the  goal  is  a  qualitative  un¬ 
derstanding  of  the  system’s  behavior,  then  partial  information  is  perfectly 
appropriate.  One  doesn’t  need  to  know  the  exact  mass  of  the  block  in  figure 
1.1  to  deduce  that  an  oscillation  will  result.  A  person  would  be  considered 
rather  slow  if  he  refused  to  make  this  prediction  until  being  informed  of  the 
1.5  kilogram  value. 

Another  type  of  qualitative  physics  decision,  the  choice  of  model  for  a 
system,  can  make  a  huge  difference  to  problem  solving  performance.  Early 
systems  for  analog  circuit  analysis,  such  as  SYN  [10],  attempted  to  solve  a 
circuit  by  propagation  of  constraints  using  the  obvious  algebraic  equations 
(all  possible  applications  of  KCL,  etc.).  Using  Macsyma’s  algebraic  manip¬ 
ulation  subroutines,  SYN  generated  intermediate  subexpressions  that  were 
much  more  complex  than  those  used  by  a  trained  engineer,  de  Kleer’s  succes¬ 
sor  programs,  QUAL  [6]  and  EQUAL  [7],  improved  on  SYN  by  exploiting  the 
qualitative  knowledge  and  expectations  of  an  engineer,  including  simplified 
models  of  devices  that  drastically  facilitate  reasoning  when  appropriate. 

An  understanding  of  how  humans  reason  effectively  about  complex  phys¬ 
ical  systems  would  have  many  uses.  A  theory  of  the  knowledge  used  in 
qualitative  physics  would  make  it  much  easier  to  train  people  to  perform 
at  expert  levels  of  competence.  In  addition,  qualitative  physics  programs 
could  explain  their  reasoning  with  ‘causal  arguments’  [18]  formed  from  the 
dependencies  recorded  by  constraint  propagation  algorithms.  The  resulting 
intelligent  tutoring  systems  could  teach  physics  and  engineering  more  prag¬ 
matically.  Qualitative  physics  also  forms  the  foundation  for  model- based 
theories  of  design  [48]  and  diagnosis  [5,12]. 

Besides  its  immediate  application,  work  on  qualitative  physics  has  an  im¬ 
pact  on  a  more  general  study  of  intelligence.  Since  any  thorough  investigation 


into  the  structure  of  knowledge  and  reasoning  in  a  domain  is  likely  to  reveal 
issues  that  apply  to  other  domains  as  well,  one  might  as  well  select  a  domain 
based  on  the  expected  ease  of  progress.  Compared  to  most  any  other  area, 
the  domain  of  simple  physical  devices  is  easier  to  codify. 

1.4  Why  Comparative  Analysis? 

Comparative  analysis,  the  qualitative  analog  of  sensitivity  analysis,  is  the 
problem  of  determining  how  and  why  the  behavior  of  a  system  will  change 
when  its  structure  is  changed.  Even  more  important  than  the  prediction 
of  the  direction  of  change  is  comparative  analysis’  explanation  of  why  the 
change  will  occur.  Many  artificial  intelligence  problems,  including  design, 
diagnosis,  and  intelligent  tutoring  systems,  have  comparative  analysis  as  an 
important  component;  the  explanation  is  used  in  many  different  ways. 

•  One  method  of  automated  design  is  the  principled  modification  of  pre¬ 
vious  designs  [48].  For  example,  suppose  a  library  design  for  a  VLSI 
pullup  circuit  has  too  long  a  rise  time.  If  the  problem  solver  considers 
increasing  the  width  of  some  wire  to  decrease  the  rise  time,  it  would 
like  to  know  the  ramifications  of  this  modification  relative  to  the  initial 
behavior.  Will  the  delay  decrease?  What  happens  to  power  dissipation? 
Comparative  analysis  answers  these  questions,  in  qualitative  terms,  as 
is  appropriate  for  initial  design  evaluation.  By  analyzing  an  explana 
tion  for  why  the  changes  happen,  the  problem  solver  could  then  focus 
on  further  changes  to  counteract  undesired  effects. 

•  Many  of  the  programs  which  perform  diagnosis  from  first  principles 
use  generate  and  test  paradigms  [19].  Comparative  analysis  can  sim¬ 
plify  diagnosis  of  continuous  systems  (such  as  analog  electronics)  in 
two  ways.  Comparative  analysis  provides  a  direct  test  for  certain  hy¬ 
pothesized  faults;  if  one  suspects  a  resistor  of  a  low  value,  comparative 
analysis  can  predict  the  resulting  behavior.  If  this  prediction  does  not 
match  the  observed  behavior,  the  generator  might  use  the  explanation 
to  suggest  or  rule  out  additional  candidate  faults. 

•  A  key  subproblem  of  intelligent  tutoring  systems  (ITS)  is  the  auto¬ 
matic  explanation  of  the  behavior  of  complex  systems.  Most  AI  work 


in  this  direction  has  focused  on  the  role  of  qualitative  simulation  when 
explaining  the  mechanism  through  which  devices  achieve  functionality 
[43,18].  Qualitative  simulation  is  a  critical  component  of  explanation 
generation,  but  understanding  how  systems  respond  to  changes  is  also 
important.  One  doesn’t  really  understand  the  workings  of  a  refrigera¬ 
tor,  if  one  can’t  explain  the  effect  of  a  stronger  compressor  on  efficiency 
and  minimum  temperature. 

While  this  thesis  may  be  viewed  as  a  detailed  investigation  of  the  com¬ 
parative  analysis  problem,  it  can  also  be  seen  in  a  more  general  light.  The 
analysis  of  the  relative  merits  of  DQ  analysis  and  exaggeration  exposes  is¬ 
sues  and  tradeoffs  that  apply  to  all  of  qualitative  physics  and  model-based 
reasoning.  Through  a  careful  study  of  comparative  analysis,  much  is  learned 
about  the  soundness  /  completeness  dichotomy,  the  importance  of  model¬ 
ing  in  model-based  reasoning,  and  the  fundamental  limitations  of  qualitative 
arithmetic. 

1.5  Differential  Qualitative  Analysis 

Differential  qualitative  (DQ)  analysis  is  a  powerful  technique  for  solving  com¬ 
parative  analysis  problems.  It  predicts  the  effect  of  a  small  structural  change 
by  propagating  the  change  through  the  equations  modeling  the  system.  The 
result  is  commonly  called  a  ‘causal  explanation’  because  it  is  viewed  as  a 
linear  chain  of  consequences  based  on  the  original  change  or  cause.  For  the 
technique  to  work,  it  is  necessary  to  describe  structural  and  behavioral  per¬ 
turbations  in  a  formal  language  so  that  they  can  be  manipulated  symbolically. 
To  this  end,  DQ  analysis  relies  on  relative  change  (RO)  values  using  one  or 
more  perspectives  (section  1.5.1).  Once  the  original  perturbation  is  described 
using  RC  values,  a  set  of  inference  rules  propagate  the  changes  through  the 
equations  that  model  the  system  and  produce  a  causal  chain  that  embodies 
the  explanation  (figure  1.2). 

1.5.1  Perspectives 

Perspectives,  the  most  important  concept  in  DQ  analysis,  are  best  introduced 
with  an  example.  Consider  the  horizontal,  frictionless  spring/block  system 


Inference 

Rules 


Behavior 


F  =  KX 
F  =  MA 


Model 

Perturbation:  M* 


Constraint 

Propagator 


Duration 


Relative  Change  Output 


Figure  1.2:  Overview  of  the  DQ  Analysis  Algorithm 

shown  above  (figure  1.1).  The  system  can  be  defined  in  Kuipers’  QSIM  [27] 
notation  in  terms  of  six  parameters,  each  a  function  of  time:  spring  constant 
K ,  mass  M,  position  X ,  velocity  V,  acceleration  A,  and  force  F  related  by 
Newton’s  second  law  (F  =  MA)  and  Hooke’s  law  (F  =  -KX).  Mass  and 
spring  constant  are  independent  parameters  that  have  constant  values  over 
time.  The  initial  conditions  are  specified  as  follows:  M( 0)  >  0,  fif(0)  < 
0,  V'(O)  =  0,  and  X(0)  =  x0  <  0. 

This  description  may  now  be  simulated,  but  because  of  ambiguities  inher¬ 
ent  in  qualitative  values  [28],  QSIM  produces  several  possible  behaviors  for 
this  system,  including  ones  corresponding  to  increasing,  decreasing,  and  sta¬ 
ble  oscillation.  Although  comparative  analysis  could  be  done  on  all  of  these 
behaviors,  for  this  example,  I  assume  the  interpretation  of  stable  oscillation 
(figure  1.3). 

Now  we  are  ready  to  pose  a  comparative  analysis  problem.  “What  hap¬ 
pens  to  the  period  of  oscillation  if  the  mass  of  the  block  is  increased?”  The 
answer  is  that  the  length  of  the  period  increases: 

Since  force  is  inversely  proportional  to  position,  the  force  on 
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Figure  1.3:  QSIM  Behavior  for  Stable  Spring  Oscillation 


the  block  will  remain  the  same  when  the  mass  is  increased.  But 
if  the  block  is  heavier,  then  it  won’t  accelerate  as  fast.  And  if  it 
doesn’t  accelerate  as  fast,  then  it  will  always  be  going  slower  and 
so  will  take  longer  to  complete  a  full  period  (assuming  it  travels 
the  same  distance). 


What  kind  of  information  is  needed  to  produce  this  explanation?  Take 
the  first  step:  “The  force  on  the  block  will  remain  the  same.”  This  is  an  ex¬ 
ample  of  a  relative  change  (RC)  statement  since  it  expresses  the  relationship 
between  values  in  the  original  and  perturbed  systems.  To  distinguish  the 
perturbed  force  from  the  original,  I  denote  it  F  and  plot  it  with  dolled  lines 
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(figure  1.4).  The  question  is  what  does  it  mean  for  force  to  be  the  ‘same’? 


Figure  1.4:  Actual  Plot  of  Force  versus  Time 

Clearly,  F  ^  F  as  a  function  of  time.  The  corresponding  values  of  F  and 
F  are  different  for  almost  every  possible  time.  The  real  meaning  of  “The 
force  on  the  block  will  remain  the  same”  is  that  F  and  F  are  the  same  for  all 
values  of  X.  Although  this  reparametrization  was  not  mentioned  explicitly 
in  the  explanation,  it  is  essential  to  the  soundness  of  the  argument. 

In  order  to  allow  programs  to  generate  and  evaluate  explanations  like  the 
one  for  the  spring  and  block,  it  is  necessary  to  take  this  implicit  change  of 
parameters  and  make  it  explicit.  I  do  this  with  the  use  of  ‘perspectives’.  Thus 
the  first  line  of  the  argument  could  be  rewritten  “If  the  mass  is  increased, 
force  does  not  change  from  the  perspective  of  position.”  Making  perspectives 
explicit  is  the  crucial  step  in  performing  DQ  analysis  to  solve  a  comparative 
analysis  problem.  Once  the  notion  of  perspective  is  explicit,  one  can  address 
questions  like  “Which  perspective  best  suits  a  problem”  and  “What  inferences 
are  sound?”  The  answers  are  not  as  obvious  as  they  might  appear. 

For  example,  consider  the  ‘obvious’  inference  “Since  it  is  going  slower  it 
will  take  longer  to  go  the  same  distance.”  What  does  it  mean  for  the  block 
to  be  going  slower?  From  what  perspective  is  velocity  lower?  If  velocity 
were  lower  from  the  perspective  of  time,  then  the  conclusion  would  indeed 
be  obvious.  But  just  as  with  the  parameter  force  (figure  1,4),  there  are 
times  when  the  perturbed  velocity  is  not  lower  than  it  was  in  the  original 
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system.  Once  again,  position  is  the  correct  perspective.  In  fact,  as  shown  in 
section  2.2,  the  explanation  is  correct,  but  it  would  not  necessarily  be  so  if 
the  perspective  was  a  parameter  other  than  position. 

Reasoning  about  perspectives  explicitly,  and  using  sound  rules  of  DQ 
analysis  (section  2.2),  the  zetalisp  program,  CA,  has  correctly  generated  the 
correct  solution  and  an  explanation  like  that  shown  above.  CA  solves  this 
next  question  by  using  perspectives  in  a  different  way:  “What  happens  to 
the  maximum  velocity  if  the  initial  displacement  is  increased?” 

Since  K  and  M  haven’t  changed,  the  force  on  the  block  is 
the  same  for  any  position  that  the  block  used  to  pass  through. 

So  the  acceleration  is  the  same  for  any  position.  But  since  the 
initial  displacement  has  been  increased,  the  block  will  already  be 
moving  when  it  reaches  the  old  initial  position,  where  previously 
the  block  was  stopped.  Since  the  accelerations  are  the  same  from 
here  on,  and  the  block  is  already  moving  faster,  it  will  keep  on 
moving  faster  and  will  have  a  higher  maximum  velocity. 

The  rules  which  compose  this  reasoning  are  explained  in  section  2.2. 

1.5.2  Changes  in  Behavioral  Topology 

The  previous  section  showed  how  the  explicit  use  of  perspectives  could  de¬ 
termine  the  relative  change  of  parameter  values  and  time  durations  given  an 
initial  perturbation.  However,  sometimes  the  perturbation  results  in  change 
of  a  more  fundamental  nature.  Consider  the  heat  exchanger  shown  in  1.5. 
Hot  oil  flows  through  a  pipe  immersed  in  a  vessel  of  cold  water.  A  qualitative 
simulator  such  as  QSIM  takes  this  description  and  predicts  the  possible  be¬ 
haviors  of  the  system  as  the  oil  cools  while  passing  through  the  pipe.  Figure 
1.6  shows  a  possible  QSIM  behavior  that  corresponds  to  the  case  when  the 
hot  oil  reaches  thermal  equilibrium  just  as  it  exits  from  the  pipe.  (Remem¬ 
ber  that  since  this  is  a  qualitative  plot,  the  apparent  slope  does  not  imply 
that  these  functions  are  linear.)  Let’s  pose  a  comparative  analysis  prob¬ 
lem.  “What  happens  to  the  behavior  of  the  heat  exchanger  if  the  thermal 
conductivity  of  the  pipe  wall  is  increased?” 

The  answer  is  that  the  oil  will  reach  thermal  equilibrium  more  quickly 
than  before.  And  since  the  oil  is  flowing  through  the  exchanger  at  the  same 


Figure  1.5:  Hot  Oil  Flows  Through  Heat  Exchanger 


rate,  it  must  reach  thermal  equilibrium  before  leaving  the  pipe  (figure  1.7). 
Thus,  unlike  the  previous  examples  where  the  perturbation  resulted  only 
in  continuous  changes  in  various  parameters,  the  perturbation  of  the  heat 
exchanger  caused  a  discontinuous  change  in  the  behavioral  structure:  the 
previously  cotemporaneous  ‘events’ of  thermal  equilibrium  and  disgorgement 
from  the  pipe  now  happen  at  different  times. 

I  call  the  switch  from  figure  1.6  to  1.7  a  change  in  behavioral  topology. 
This  example  is  a  simple  case  of  topological  change:  the  initial  behavior 
was  inconsistent  and  a  single  new  behavior  was  indicated.  However,  the 
situation  isn’t  always  so  easy.  Section  2.5  describes  how  perturbations  can 
lead  to  multiple  consistent  behaviors  and  presents  heuristics  for  determining 
the  most  likely  resulting  behavior. 


1.6  Exaggeration 

Exaggeration  solves  comparative  analysis  problems  in  a  completely  differ¬ 
ent  way  from  DQ  analysis;  it  converts  the  comparative  analysis  question  to  a 
simulation  problem  concerning  an  exaggerated  system  where  the  original  per¬ 
turbation  has  been  taken  to  a  limit,  and  then  analyzes  the  resulting  behavior. 
This  process  decomposes  naturally  into  three  phases. 
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1.6.1  Transform,  Simulate,  and  Scale  Phases 


Consider  the  heat  exchanger  from  the  last  section  (figure  1.5)  in  which  hot 
oil  cools  as  it  passes  through  a  cold  water  reservoir.  Given  the  comparative 
analysis  question  “What  happens  to  the  oil  output  temperature,  if  it  moves 
through  the  pipe  more  quickly?”  exaggeration  uses  the  following  reasoning: 


If  the  velocity  were  infinite,  then  the  oil  would  spend  negligible 
time  in  the  exchanger,  so  it  would  loose  practically  no  heat.  Thus 
increasing  the  speed  even  a  small  amount  should  cause  the  output 
temperature  to  rise. 


This  explanation  clearly  demonstrates  the  three  phases  of  exaggeration 
(summarized  in  figure  1.8).  The  transform  phase  converts  the  comparative 
analysis  problem  to  a  simulation  problem.  Since  the  comparative  analysis 
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Figure  1.7:  Perturbed  Behavior  of  Heat  Exchanger 

question  concerned  a  perturbation  in  velocity,  the  transform  phase  generates 
a  description  of  a  heat  exchanger  in  which  the  oil  moved  with  infinite  speed. 

The  simulate  phase  takes  this  exaggerated  description  and  performs  qual¬ 
itative  simulation  to  generate  its  behavior.  In  this  example,  the  simulate 
phase  predicts  that  the  oil  will  exit  after  negligible  time  and  after  loosing 
negligible  heat.  Although  this  phase  is  conceptually  simple,  many  techni¬ 
cal  difficulties  complicate  the  process  of  simulating  systems  with  infinite  and 
infinitesimal  parameters.  As  a  result,  the  bulk  of  chapter  3  concerns  exag¬ 
geration’s  simulate  phase. 

The  scale  phase  takes  the  exaggerated  behavior  from  the  simulate  phase 
and  compares  it  to  the -original  behavior  in  an  attempt  to  answer  the  com¬ 
parative  analysis  question.  In  this  case  it  finds  that  the  slow  moving  oil 
lost  more  heat  than  oil  moving  at  infinite  speed.  Since  a  large  increase 
>n  velocity  caused  a  drop  in  heat  loss,  the  scale  phase  concludes  that  any 
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Figure  1.8:  Overview  of  the  Exaggeration  Algorithm 

increase  in  speed  should  result  in  an  increase  in  exit  temperature.  Unfortu¬ 
nately,  while  the  conclusion  is  correct  for  this  example,  the  inference  is  not 
in  general  sound.  It  assumes  (among  other  things)  that  the  system  responds 
monotonically  to  the  perturbation.  Unlike  DQ  analysis,  exaggeration  is  not 
guaranteed  to  make  correct  predictions.  On  the  other  hand,  exaggeration 
solves  a  wider  class  of  problems  than  DQ  analysis  and  often  produces  a  more 
elegant  explanation. 

1.6.2  Qualitative  Hyperreal  Representation 

Since  exaggeration  works  by  transforming  a  perturbation  to  a  limit  and  an¬ 
alyzing  the  resulting  asymptotic  behavior,  it  is  critical  to  have  a  represen¬ 
tation  capable  of  describing  infinitesimal  and  infinite  values.  I  meet  this 
requirement  by  extending  Kuipers’  QSIM  quantity  space  notation  using  the 
hyperreal  numbers  of  nonstandard  analysis  [33,25].  Figure  1.9  shows  some 
of  the  values  in  the  hyperreal  quantity  space  for  the  heat  parameter. 

There  are  actually  many  infinite  hyperreal  numbers,  but  the  qualitative 
hyperreal  representation  collapses  them  all  onto  the  symbols  inf  and  minf 
depending  on  sign.  Every  landmark  value  (e.g.,  q0)  has  a  halo  of  numbers  that 
are  infinitesimally  close;  the  two  halves  of  this  halo  are  denoted  (HALO  q0  +) 
and  (HALO  q0  — )  respectively.  The  positive  infinitesimals,  for  example,  are 

15 


m 

»  "ft*  i 


ii 


(halo  0  J\\a\o  0  +)  (halo  q  -)  ^halo  qQ  +) 

S - MfK -  H|K  °  S 

-^inf.  €^-  0  -<0,  q  >-  q  -<q ,  lnf>-  Inf 


Figure  1.9:  Some  Values  in  the  Heat  Hyperreal  Quantity  Space 
represented  (HALO  0  +). 

The  qualitative  hyperreal  representation  (section  3.1)  of  a  parameter’s 
state  has  two  parts:  value  and  dervative;  square  brackets  are  used  to  denote 
the  qualitative  state.  Thus,  to  say  that  velocity  is  infinite  at  time  t0  and 
steady,  one  could  write: 

[V(t0)]  =  ( inf,  std) 

Since  V  =  A  X,  this  implies  that  X  is  increasing  infinitely  fast  at  t0;  if  its 
value  is  zero,  one  could  write: 

TOo)]  =  (0,(mc  inf)) 

To  say  that  there  is  an  interval  of  time,  A  when  heat  infinitesimally 
less  than  its  original  value,  q0,  and  decreasing  with  infinitesimal  (negligible) 
speed,  one  would  write: 

[£(■4)]  =  ((HALO  q0  -),(dec  negl)) 

To  describe  the  interval,  B,  when  heat  is  between  the  landmark  values  of  zero 
and  q0 ,  not  in  the  halo  of  either,  and  still  slowly  decreasing,  one  would  write: 

[<?(#)]  =  (<0,qo>,(dec  negl)) 

The  presence  of  infinite  and  infinitesimal  derivatives  necessitates  an  en¬ 
hanced  temporal  representation.  Elegance  dictates  that  time  should  be 
treated  no  differently  than  other  parameters,  and  a  hyperreal  abstraction 
indeed  fits  well.  A  qualitative  state  may  last  for  a  closed  instant  of  time 
(written  0),  or  an  open  interval  of  infinitesimal  (negl),  finite  (fin),  or  infinite 
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( inf)  duration.  This  raises  a  difficult  problem  for  qualitative  simulation  — 
how  can  one  tell  how  long  it  takes  a  parameter  to  change  from  one  qualitative 
state  to  another?  To  solve  this  problem,  the  simulate  phase  of  exaggeration 
uses  two  novel  techniques:  predecessor- persistence  filtering  and  successor- 
arrival  filtering. 

1.6.3  Persistence  and  Arrival  Filtering 

The  insight  behind  the  dual  techniques  of  predecessor-persistence  filtering 
and  successor-arrival  filtering  is  the  following  observation  about  transitions 
in  the  qualitative  hyperreal  representation: 

It  may  take  longer  for  a  parameter  to  transition  to  a  new 
qualitative  state  than  it  spends  in  its  old  state. 

Lest  this  sound  confusing,  consider  the  following  concrete  example.  Let 
I  be  a  parameter  defined  as  the  identity  function  I(t)  =  t.  Consider  the 
length  of  the  time  interval,  A,  in  which  [/(>!)]  =  ((halo  0  +  ),(mc  fin)), 
defined  as  PERSISTENCE  of  the  qualitative  state  in  section  3.3.4.  I  claim  that 
I  persists  in  (halo  0  +)  for  negl  time.  For  example,  if  /  persisted  in  the  halo 
for  a  standard  real  time,  t0,  then  that  would  imply  that  t0  €  (HALO  0+),  in 
other  words  that  t0  is  infinitesimal,  not  a  standard  real.  Likewise  0  and  inf 
persistences  also  lead  to  contradictions,  thus  I  persists  in  (HALO  0  +)  for 
negl  time. 

Now  consider  the  time  it  takes  for  I  to  reach  the  next  qualitative  state, 
-(0,  infy  (formalized  as  SUCCESSOR-ARRIVAL  TIME  in  section  3.3.5).  I  argue 
that  /’ s  successor-arrival  time  is  fin.  By  definition  of  -<0,  inf>-,  when  / 
reaches  this  qualitative  value  it  must  have  taken  a  standard  real  value,  r0. 
Thus  r0  time  must  have  elapsed  since  /  left  0.  Since  only  negl  time  passed 
reaching  (HALO  0  +)  from  0,  /  takes  fin  -  negl  =  fin  time  to  arrive  at  its 
new  qualitative  state.  In  other  words,  even  though  there  is  no  intervening 
hyperreal  value  sandwiched  between  (HALO  0  +)  and  -<0,  inf>-,  I  takes 
longer  to  reach  its  new  qualitative  state  than  it  spends  in  its  original  state. 
The  cause  of  this  apparently  mysterious  behavior  is  the  unintuitive  nature  of 
the  order  topology  of  the  hyperreal  numbers  (explained  in  detail  in  chapter 
3).  Fortunately,  the  prescription  is  simple:  a  hyperreal  qualitative  simulator 
must  distinguish  between  the  time  that  a  predecessor  state  persists  and  the 
time  required  to  reach  a  successor  state. 
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To  see  how  these  two  metrics  are  used,  consider  the  first  few  decisions  the 
simulate  phase  must  make  concerning  the  infinite  flow- rate  heat  exchanger. 
The  transform  phase  constructs  an  initial  state  that  has  oil  position  equal  to 
the  left  end  of  the  pipe  and  increasing  infinitely  fast,  [AT(0)j  =  (x0,  ( inc  inf)) 
Heat  is  equal  to  some  initial  value  and  is  decreasing  at  a  finite  rate,  [(?(0)]  = 
( q0,(dec  fin)).  How  long  does  this  state  last  and  what  are  its  successors? 

The  notion  of  persistence,  the  maximum  length  of  time  a  parameter  can 
remain  at  a  qualitative  state,  answers  this  question.  To  determine  time  one 
needs  a  measure  of  distance  and  speed.  The  speed  measurement  is  easy; 
it  conies  from  the  parameter’s  the  qualitative  derivative.  The  appropriate 
distance  measurement  turns  out  to  be  the  ‘width’  of  the  qualitative  state, 
which  is  0  for  a  point  value.  Since  0  divided  by  any  nonzero  rate  is  0,  and  since 
both  parameters  have  point  values,  they  can  persist  in  their  current  values 
for  at  most  a  point  of  time.  This  implies  that  in  the  successor  state  both 
position  and  heat  have  moved  a  negligible  distance  from  their  initial  values: 
[X(A)1  =  ((HALO  x0  +),  (inc  inf))  and  [^(A)]  =  ((HALO  q0  -),{dec  fin)). 
How  long  does  this  A.\  last  and  what  state  succeeds  it? 

To  answer  this  question,  a  simulator  needs  to  reason  about  both  persis¬ 
tence  and  arrival  times.  The  width  of  each  parameter’s  current  values  is  neg- 
ligible,  negl.  Since  Q  is  moving  with  finite  rate,  its  persistence  is  =  negl. 

Although  velocity  is  infinite,  X  has  the  same  persistence:  =  negl.  Thus 

persistence  values  show  that  the  state  will  last  for  negl  time  but  do  not  pre¬ 
dict  whether  X  will  change  values  before  Q  or  whether  they  will  transition 
at  the  same  time.  To  determine  this,  arrival  values  are  necessary. 

The  time  required  to  reach  one  qualitative  state  from  another  is  dependent 
on  the  distance  between  the  two.  Since  both  Q  and  X  are  moving  from 
the  infinitesimal  halo  surrounding  a  point  value  into  an  open  interval  of 
standard,  finite  real  numbers,  they  must  each  traverse  fin  distance  before 
arriving  at  their  successor  qualitative  states.  Like  persistences,  arrival  times 
are  computed  by  dividing  distance  by  rate:  Q  arrives  in  =  fin  time  while 

X  only  requires  =  negl  time.  This  means  that  X  must  change  qualitative 

states  before  Q,  so  the  successor  state  has  [yY(^42)l  —  infi~,(inc  inf)) 

and  while  Q  remains  in  (HALO  qo  — ). 
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Without  the  predecessor-persistence  and  successor-arrival  filters  qualita¬ 
tive  simulation  using  the  qualitative  hyperreal  representation  would  produce 
a  huge  number  of  inconsistent  behaviors.  Such  weakness  in  the  simulate 
phase  would  render  exaggeration  impotent  to  solve  most  comparative  analysis 
problems.  Efficient  computation  of  persistence  and  arrival  values,  therefore, 
is  central  to  exaggeration’s  success. 

1.7  Conclusions 

This  thesis  makes  several  contributions  to  the  field  of  qualitative  physics. 

•  It  develops  a  precise  formulation  of  relative  change  that  extends  earlier 
attempts  [16]  by  explicitly  accounting  for  multiple  perspectives  (sec¬ 
tions  2.1.2  and  2.1.3). 

•  It  presents  inference  rules  for  performing  differential  qualitative  analysis 
and  proves  their  soundness  (section  2.2). 

•  It  discusses  an  implementation  of  DQ  analysis  and  uses  it  to  test  the 
theory  (section  2.3). 

•  It  extends  the  quantity  space  representation  to  account  for  infinitesimal 
and  infinite  hyperreal  numbers  (section  3.1). 

•  It  discusses  the  implementation  of  a  qualitative  hyperreal  simulator 
that  uses  many  new  ideas  (four  transition  tables,  predecessor-persistence 
filtering,  successor-arrival  filtering)  to  reduce  ambiguity  (section  3.3). 

•  It  introduces  exaggeration,  a  novel  method  for  solving  comparative 
analysis  problems,  and  shows  how  qualitative  hyperreal  simulation  is 
central  to  its  operation  (chapter  3). 

•  It  compares  the  two  comparative  analytic  techniques  on  a  wide  variety 
of  dimensions  so  that  future  researchers  can  easily  understand  their 
strengths  and  weaknesses  and  use  them  effectively  as  black  boxes. 

Neither  DQ  analysis  nor  exaggeration  is  perfect,  but  their  strengths  sup¬ 
port  each  other.  DQ  analysis  is  sound;  it  produces  no  incorrect  answers,  but 
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there  are  many  cases  where  it  doesn’t  answer  at  all.  While  exaggeration  can 
produce  a  false  predictions  from  systems  that  are  not  monotonic,  it  answers 
a  wider  class  of  problems  than  does  DQ  analysis.  These  complementary  abil¬ 
ities  suggest  a  powerful  high  level  architecture.  Given  a  problem,  first  try  to 
solve  it  with  DQ  analysis.  If  that  works,  then  a  sound  answer  is  guaranteed. 
If  DQ  analysis  fails,  then  apply  exaggeration.  Now  check  exaggeration’s  pre¬ 
dictions  with  all  of  the  relative  change  values  that  DQ  analysis  is  able  to 
deduce.  If  they  all  agree,  the  chances  are  good  that  nonmonotonic  behav¬ 
ior  is  absent.  Finally,  exaggerate  the  perturbation  in  the  opposite  direction 
and  check  that  the  resulting  predictions  are  the  opposite  of  the  first  trans¬ 
formation.  Although  there  will  still  be  pathological  cases,  these  precautions 
maximize  the  heuristic  power  of  the  exaggeration  method. 
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Chapter  2 


Differential  Qualitative 
Analysis 


Differential  qualitative  (DQ)  analysis  solves  comparative  analysis  problems 
by  propagating  the  effects  of  a  perturbation  through  the  structural  model  of 
the  system.  DQ  analysis  requires  three  inputs:  a  description  of  the  system’s 
behavior  (from  a  qualitative  simulator),  the  structural  equations  defining  the 
system  model,  and  a  perturbation.  A  forward  chaining  constraint  propagator 
uses  a  set  of  inference  rules  to  deduce  the  system’s  resulting  change  in  behav¬ 
ior.  As  these  rules  contain  the  knowledge  necessary  to  perform  DQ  analysis, 
a  discussion  of  them  forms  the  bulk  of  this  chapter.  However,  before  the  in¬ 
ference  rules  can  be  explained,  it  is  necessary  to  define  more  precisely  how  an 
input  perturbation  and  the  behavioral  output  can  be  represented  as  relative 
change  (RC)  values. 


2.1  Preliminaries 

As  my  formalism  is  based  on  that  used  by  Kuipers  for  QSIM  [27],  I  start  out 
by  summarizing  his  definitions. 

Definition  1  A  PARAMETER  is  a  reasonable  function  of  time. 

See  [27]  for  the  actual  definition  of  reasonable  function;  the  intuition  is 
that  of  continuity,  continuous  differentiability,  and  a  finite  number  of  critical 
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points  (places  where  its  derivative  is  zero).  Parameters  are  denoted  by  capital 
letters.  Thus  the  velocity  of  a  projectile  might  be  described  by  the  parameter, 
V,  which  is  a  function  that  maps  time  to  velocity. 

Definition  2  Each  parameter  has  an  associated  set  of  LANDMARK  VALUES 
which  is  a  subset  of  the  range  of  the  parameter.  The  landmark  values  always 
include  (but  aren’t  restricted  to)  zero,  the  values  of  the  parameter  at  the 
beginning  and  ending  times,  and  the  values  of  the  parameter  at  each  of  its 
critical  points.  A  time,  t,  is  a  DISTINGUISHED  TIME  POINT  of  a  parameter 
P  if  it  is  a  boundary  element  of  the  set  of  times  that  P(t )  =  pi  for  some 
landmark  value  pi. 

Landmark  values  are  those  values  considered  to  be  interesting  to  the 
human  observer,  and  the  times  when  these  values  are  reached  are  of  interest 
too.  When  a  parameter  becomes  constant  for  an  interval  of  time,  then  it  will 
take  on  a  landmark  value  for  infinite  number  of  time  points.  This  is  why  the 
definition  only  considers  the  boundary  times  distinguished. 

Definition  3  A  SYSTEM  is  a  set  of  parameters  that  are  related  with  a  STRUC¬ 
TURAL  DESCRIPTION  that  consists  of  a  finite  set  of  qualitative  differential 
equations  defined  using  the  following:  time  differentiation,  addition,  multi¬ 
plication,  and  relation  by  monotonic  functions. 

Kuipers’  program,  QSIM,  takes  a  system  and  a  set  of  initial  values  for  each 
of  the  parameters  and  produces  a  set  of  possible  behaviors  for  the  system; 
the  definitions  below  describe  this  behavioral  output: 

2.1.1  Qualitative  Behavior 

Definition  4  Let  p0  <  ...  <  p*  be  the  landmark  values  of  a  parameter  P. 
For  any  time  t  define  the  value  of  P  at  t  as: 

nv.wp  n  _  /  P:  if  P(t)=  landmark  Pj 

Q  VALf r,t)  -  |  (Wfft>i)  ifp{t)  €  {pjipj+l) 

Define  the  direction  of  P  at  t  as: 
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QDIR  (P,t)  = 


inc 

ifitP(t)>  0 

std 

if£P(t)  =  0 

dec 

if£P(t)<  o 

Define,  QS (P,t),  the  state  of  P  att,  as  the  pair:  (QVAL(P,t),QDlR(P,t)) 

The  qualitative  state  over  the  interval  between  two  adjacent  distinguished 
time  points  is  defined  similarly. 

Definition  5  For  any  parameter  P,  the  BEHAVIOR  of  P  is  a  sequence  of 
states  of  P: 

QS (P,  to),  QS( P,  to,  <0,  QS(  P,t\), . . . ,  QS(  P,  tn_x,tn),  QS( P,  tn) 

alternating  between  states  at  distinguished  time-points,  and  states  on  intervals 
between  distinguished  time-points. 

Recall  that  a  system  contains  a  set  of  parameters  each  with  its  own  land¬ 
marks  and  distinguished  time  points. 

Definition  0  The  DISTINGUISHED  TIME-POINTS  of  a  system  are  the  union 
of  the  distinguished  time-points  of  the  parameters.  Thus  the  state  of  a  system 
changes  whenever  the  state  of  any  parameter  changes.  The  BEHAVIOR  of  a 
system  is  thus  a  sequence  of  system-states  alternating  between  distinguished 
time-points  and  intervals. 

To  perform  comparative  analysis  it  is  necessary  to  abstract  away  from 
specific  times,  since  two  different  systems  may  have  analogous  behaviors, 
but  change  states  at  different  times.  This  is  where  my  formal  treatment 
diverges  from  that  of  Kuipers. 

Definition  7  A  parameter  is  said  to  reach  a  TRANSITION  when  its  qualita¬ 
tive  value  changes  from  one  QVAL  to  another.  A  system  is  said  to  reach  a 
TRANSITION  when  any  parameter  transitions.  Transitions  only  occur  at  dis¬ 
tinguished  time-points,  and  every  distinguished  time  point  marks  a  transition. 
It  will  prove  useful  to  be  able  to  refer  to  these  transitions  independent  of  the 
time  at  which  they  occur,  thus  the  sequence  of  transitions  for  a  behavior  will 
b:  denoted  by  the  set  {7<}.  Every  behavior  also  has  a  TIME  FUNCTION,  Z, 
which  takes  transitions  to  the  distinguished  time-points  when  they  occur. 
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The  intuition  is  that  each  7  marks  an  event  which  changes  the  state  of 
the  system.  When  comparing  two  behaviors,  I  match  them  up  event  by  event 
and  use  the  time  functions  to  tell  whether  one  system  is  changing  faster  or 
slower  than  the  other. 

2.1.2  Comparing  Two  Behaviors 

To  compare  two  behaviors,  they  must  be  distinguishable;  I  use  the  hat  accent 
to  denote  the  second  behavior.  Thus  T  denotes  the  time  function  of  the  sec¬ 
ond  system,  and  F(T(7i))  denotes  the  second  system’s  value  of  F  at  the  time 
of  the  first  transition.  To  simplify  the  problem  of  of  comparative  analysis,  I 
start  by  only  comparing  systems  with  identical  structural  descriptions  whose 
behaviors  are  topologically  equal,  as  defined  below. 

Definition  8  The  behaviors  of  two  systems,  S  and  S,  are  TOPOLOGICALLY 
EQUAL  if  they  have  the  same  sequence  of  transitions,  7o,--->7fc,  and  forall  i 
such  that  0  <  i  <  k, 

QS(S,T(7,))  =  QS(5,f(7,)) 

and  forall  i  such  that  0  <  i  <  k, 

QS(5,T(7,),T(7l+1))  =  QS(5,f(7<),f(7I+1)) 

The  assumption  of  topological  equality  rules  out  possibilities  like  the  block 
failing  to  make  a  complete  oscillation  if  its  mass  was  increased  too  much,  but 
it  does  allow  a  certain  pliability.  If  two  behaviors  are  topologically  equal, 
their  respective  sets  of  landmarks  share  the  same  ordinal  relationships,  but 
the  underlying  real  values  for  the  landmarks  can  be  different. 

Section  2.5  explains  how  this  assumption  can  be  relaxed,  but  even  with 
it,  the  problem  is  nontrivial.  Consider  two  oscillating  spring-block  systems. 
Even  if  the  blocks  have  different  mass  and  the  spring  constants  differ,  the 
two  systems  have  topologically  equal  behavior.  Yet  the  relative  values  of 
parameters  such  as  period  of  oscillation  may  be  different.  These  are  the  first 
changes  that  comparative  analysis  must  determine. 

Before  I  can  explain  the  techniques  for  performing  comparative  analysis, 

I  need  to  present  a  notation  for  describing  the  desired  output.  It’s  easy  to 
compare  the  values  of  parameters  at  transition  points: 


24 


Definition  9  Given  a  parameter,  F,  and  a  transition  7 it  define  the  RELA¬ 
TIVE  CHANGE  (RC)  of  F  at  7,  as  follows: 

Ffti  if\F(T(n))\>\F(T(li))\ 

FI  if  \F{T(ii))\  =  |F(T(7j))| 

F^  if  \F{T(^i))\  <  |F(T(7,))| 

For  example,  if  the  two  spring-block  systems  were  both  started  with  neg¬ 
ative  displacement  and  zero  velocity  (i.e.,  X  <  0  and  V  =  0),  their  first 
transition  would  occur  when  X  reached  zero.  This  notation  allows  one  to  ex¬ 
press  that  the  second  block  is  moving  slower  at  the  point  of  transition: 

It  is  important  to  distinguish  the  relative  change  notation  from  statements 
about  values  and  derivatives.  Even  though  V-U-j,  QVAL(  V,  T(7i))  is  positive, 
and  QDIR(Vr,T(7i))  is  std. 

The  curious  reader  may  wonder  at  the  use  of  absolute  values  in  this  def¬ 
inition.  Relative  change  could  also  be  defined  by  comparing  signed  values. 
I  call  the  approach  of  definitions  9  and  11  MAGNITUDE  SEMANTICS  and  the 
alternate  approach  SIGNED  SEMANTICS.  The  two  approaches  are  theoret¬ 
ically  equivalent.  However,  since  magnitude  semantics  appears  somewhat 
more  natural  and  simplifies  various  proofs,  it  is  the  default  for  the  rest  of  the 
paper.  In  the  places  where  signed  semantics  proves  advantageous,  it  will  be 
mentioned  explicitly. 

2.1.3  Comparing  Two  Behaviors  over  Intervals 

It  turns  out  to  be  somewhat  more  complicated  to  compare  two  behaviors 
over  the  intervals  between  transitions.  What  does  it  mean  to  says  that  one 
curve  is  lower  than  another  over  an  interval?  To  do  pointwise  comparison, 
some  notion  of  corresponding  points  is  necessary. 

The  intuition  for  the  requisite  comparison  is  displayed  in  the  explanation 
of  spring  behavior  that  was  presented  in  section  1.5.1. 

If  the  mass  of  the  block  increases,  the  force  on  the  block  is  the 
same.... 

Yet  this  doesn’t  mean  force  is  invariant  as  a  function  of  time — that  isn’t 
true.  Consider  the  time  when  the  small  block  is  at  its  rest  position;  the 


spring  applies  no  force.  But  since  the  large  block  is  moving  more  slowly,  it 
won’t  have  reached  the  rest  position  and  so  there  will  be  a  force  applied. 

What  the  statement  means  is  that  force  is  invariant  as  a  function  of 
position.  For  every  position  that  the  block  occupies,  force  is  equal  in  the 
two  systems,  even  though  the  two  blocks  occupy  the  positions  at  different 
times.  Although  parameters  are  defined  as  functions  of  time,  they  often 
need  to  be  compared  from  the  perspective  of  other  parameters.  Here  it 
proved  advantageous  to  consider  force  as  a  function  of  position.  Although 
people  understand  arguments  that  leave  these  changes  of  variable  implicit, 
the  notion  must  be  made  precise  and  explicit  if  computers  are  to  perform 
comparative  analysis.  The  notion  of  perspective  is  foundational. 

Definition  10  A  parameter,  X,  is  called  a  COVERING  PERSPECTIVE  over  a 
transition  interval  (7i,T',+x)  when  the  following  three  conditions  hold: 

1.  QDIR(A,T(7,),T(7i+i))  ^  std 

2.  A||,. 

3-  *IU 

When  just  the  first  condition  holds,  X  is  called  a  PARTIAL  PERSPECTIVE. 

When  a  parameter,  X,  is  a  partial  perspective,  it  is  strictly  monotonic  so 
its  inverse  AT"1  exists.  This  means  that  it  is  possible  to  reparameterize  any 
other  parameter,  F,  by  composing  it  with  the  inverse: 

Fx(x)  =  F(X-'(x)) 

When  A  is  a  covering  perspective,  then  Fx  and  Fx  have  the  same  domain. 
Covering  perspectives  will  prove  especially  important  in  the  inference  rules 
of  section  2.2. 

Definition  11  Given  a  parameter  F,  a  partial  perspective  X,  and  a  tran¬ 
sition  interval  ( 7s ,  7, + 1 ) ,  let  Fx  denote  F  as  a  function  of  X .  Let  V  be  the 
intersection  of  the  domains  of  Fx  and  Fx 

F  =  (A(T(7,)),A(T(7,+l)))n(A(f(7,)),A(f(7,+i))) 

Define  the  RELATIVE  CHANGE  (RC)  of  F  over  (7,,  7,  +  I)  from  the  PERSPEC¬ 
TIVE  of  X  as  follows: 
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F(|L„  i/v»  e  tf  ifVWl  >  |FxWI 
*11,1+,,  «/Vi  e  V  |/>(x)[  =  |Fx(x)| 

F'Vfc+.l  i/Vx  €  U  |F*(x)|  <  |F*(x)| 


In  other  words,  force  is  ||  from  the  perspective  of  position,  if  for  all  po¬ 
sitions  that  are  assumed  in  both  simulations  (Vx  £  U)  the  corresponding 
forces  are  equal.  The  definition  of  partial  perspective  says  when  is  it  possible 
to  use  a  parameter  as  a  perspective;  section  2.2  addresses  the  question  when 
is  it  useful  to  do  so. 

2.1.4  Time  as  a  Perspective 

Although  comparisons  of  parameters  that  have  been  reparameterized  by  per¬ 
spectives  are  more  common,  sometimes  is  is  useful  to  compare  via  corre¬ 
sponding  times.  To  keep  notation  consistent,  I  will  call  this  ‘using  time  as  a 

T 

perspective.’  The  goal  is  to  come  up  with  a  meaningful  definition  for  Pf[(lt+1) 
and  the  other  RC  values. 

One  problem  is  that  the  duration  of  the  two  time  intervals  might  be 
different.  If  so  time  acts  as  a  partial  perspective — one  quantifies  only  over 
time  in  the  shortest  interval.  Another  problem  is  that  the  two  transition 
intervals  might  start  at  different  times;  in  fact  one  interval  might  end  before 
the  other  starts,  e.g.,  T(7«)  >  T(7,+i  ).  The  solution  is  to  align  the  intervals 
before  quantifying. 


Definition  12  Given  tt parameter  P  and  an  interval  (7,,  7,+i )-  Let  U  = 
(0 ,d)  where  d  =  M/Ar(T(7,+1)  -  T(7i),T(7.>i)  -  T(7.)))-  Define  the  REL¬ 
ATIVE  CHANGE  (RC)  of  P  over  (7i,7;+i)  from  the  PERSPECTIVE  OF  TIME 
as  follows: 

PitL+i)  i/Vt  G  U  |P(f(7.)  +  t)|  >  |P(T(7i)  +  01 

P||(t.-+1)  G  U  | P(f(7i)  +  01  =  |P(T(7i)  +  01 

j,+x)  i/Vt  G  f/  |P(f (7,)  +  01  <  |P(T(7.)  +  01 

2.2  DQ  Inference  Rules 

This  section  presents  a  number  of  rules  for  computing  and  manipulating  RC 
values,  describes  how  the  rules  were  incorporated  into  a  computer  program, 
and  evaluates  the  program’s  performance. 

•  The  duration  rule  formalizes  “distance  equals  rate  times  time.” 

•  The  interval  derivative  rule  expresses  the  relationship  between  one 
derivative  and  another,  e.g.,  “more  acceleration  leads  to  higher  veloc¬ 
ity.” 

•  The  transition  derivative  rule  predicts  the  final  value  of  a  derivative 
like  velocity. 

•  The  self  reference  rule  says  that  every  parameter  appears  unchanged 
from  its  own  perspective. 

•  The  perspective  flipping  rule  allows  a  reasoner  to  change  perspectives. 

•  The  transition  and  interval  constant  rules  show  the  relationship  be¬ 
tween  constants  and  1C  values. 

•  The  end  of  time  rule  says  that  other  things  being  equal  a  parameter 
changes  more,  the  longer  it  is  changing. 

•  The  one’s  own  derivative  rule  predicts  what  happens  when  a  parameter 
is  defined  in  terms  of  itself. 


•  The  multiplication  rule  demonstrates  that  the  familiar  rules  of  quali¬ 
tative  arithmetic  apply  to  RC  values  as  well  as  derivatives. 

Each  of  the  rules  are  presented  as  theorems  since  they  are  proven  sound. 
For  simplicity,  however,  only  the  interesting  and  difficult  proofs  have  been 
included  in  this  paper.  The  rules  have  been  implemented  as  part  of  CA, 
a  ZETALISP  program  which  solves  comparative  analysis  problems  using  DQ 
analysis.  CA  uses  a  constraint  propagator  to  derive  implications  of  these 
rules.  The  resulting  dependency  structure  can  be  translated  into  an  English 
explanation1  or  used  by  an  explanation  based  generalizer.  Although  CA 
is  incomplete  (there  are  some  problems  it  for  which  it  terminates  without 
solving),  it  does  answer  and  intuitively  explain  a  large  class  of  problems. 
Because  the  rules  have  been  proven  correct,  CA  is  guaranteed  to  reach  only 
sound  conclusions. 

2.2.1  Duration  Rule 

This  rule  is  the  basis  for  the  very  powerful  inference:  distance  equals  rate 
times  duration.  If  the  rate  is  slower  in  the  second  simulation,  then  it  will  take 
longer  to  go  the  same  distance.  Although  this  may  seem  obvious,  perspectives 
are  required  to  make  precise  the  notion  of  ‘rate  is  slower’;  this  makes  it  subtle. 
Before  I  can  state  the  theorem,  the  notion  of  distance  must  be  made  clear. 

Definition  13  Let  X  be  a  parameter  which  is  increasing  and  positive  (or  de¬ 
creasing  and  negative )2  over  the  transition  interval (7;,7;+i).  Define  DISTANCE- 
BY  X  over  (7,,7,+x)  as  the  relative  change  of  the  distance  traveled  by  X  over 
the  interval  as  shown  in  the  following  table  of  qualitative  subtraction: 


lThe  CA  implementation  of  DQ  analysis  has  only  a  primitive  natural  language  gen¬ 
erator.  Unless  specified  otherwise,  all  English  text  was  produced  by  hand  translation  of 
computer  generated  dependency  networks. 

2 A  similar  definition  is  made  for  the  cases  of  increasing/negative  and  decreas¬ 
ing/positive.  This  definition  would  be  simpler  to  express  in  signed  semantics. 


Note  that  the  parameter  X  has  a  double  purpose  in  this  theorem:  it  has 
V  as  its  time  derivative,  and  it  is  also  the  perspective  from  which  V  is  seen 
to  D-.  In  the  following,  it  may  be  helpful  to  think  of  V  as  velocity,  and  X  as 
position. 

Proposition  1  Duration  Rule 

Let  V  and  X  be  parameters  such  that  X  is  a  partial  perspective  over  (7,,  7,+i ). 
Given  V  =  £X,  n£.+1)f  and  ->DISTANCE-BYXJ.I(l  J+1)  then  f(^i+l)  - 
n-u)  >  T(7.+x)  —  T(7,),  i.e.  the  duration  of  { 7,,7;|t)  will  increase. 

Proof:  Note  that  the  proof  is  not  obvious:  Vx  f  I  prove  the  case 
in  which  DISTANCE-BYAr||(t- t+1j.  This  is  equivalent  to  requiring  X  to  be  a 
covering  perspective.  Let  a  -  X(T( 7,))  and  b  —  X(T(yt+i)).  Since  A'  is  a 
covering  perspective,  X  has  an  inverse  function  taking  position  to  time: 

X-1  :  (a,b)  — >  (T(7{),  T(7i+i)) 

The  function  X-1  also  exists,  has  the  same  domain,  and  a  possibly  different 
range:  (f(ji),f(-fi+1)).  By  definition  means: 

|V'(X-1(x))|  <  |V(X-1(x))|  Vx  €  (a,  6) 

Consider  the  case3  where  V  >  0;  this  implies  that  all  values  of  V  are  greater 
than  zero  because  otherwise  the  two  systems  would  have  different  transitions, 
violating  the  topological  equality  assumption.  This  means  that: 

0  <  ^(X^x))  <  V^X"1^))  Vx  €  (a, 6) 

So: 

^  -  > . >  0  Vx  €  (a,  6) 

nx-H*)) 

So: 

fb _ L_ 

L  V(X-'(x))  Ja  mix))“^u 

3The  case  where  V  <  0  is  similar;  there  is  no  case  where  V  —  0  because  then  -V  would 
not  reach  a  transition. 


^(Xir)) 
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But  by  the  chain  rule,  the  time  derivative  of  A"  1  at  x  is  •  So: 

X~\b)  -  A_1(a)  >  X~\b)  -  X~1(a)  >  0 

Thus:  T( 7i+1)  -  >  T( 7,+l)  —  T(-)i).  In  other  words,  the  duration  of 

the  interval  increases.  □ 

It  would  be  nice  if  one  could  show  that  the  duration  rule  was  sound 
if  the  premise  was  weakened  to  have  VIJ.£ri+1)  for  some  arbitrary  covering 
perspective  P.  However,  the  following  proposition  shows  that  this  is  false; 
just  because  P ||*i+1j  for  a  perspective  X  doesn’t  mean  that  there  doesn’t 
exist  some  other  perspective  Z  such  that 

Proposition  2  Non-Uniqueness 

Given  a  system  with  parameters  P ,  X,  Y ,  and  Z  such  that  X ,  Y  and  Z  are  cov¬ 
ering  perspectives  over  (7,-,  7, +1),  then  it  is  possible  that  Pft*i+I)  and  P||^  .+1, 

and  PUjw+i). 

The  example  shown  in  figure  2.1  illustrates  the  proof  by  construction. 
The  thin  lines  indicate  the  values  of  the  first  system  while  the  dotted  lines 
indicate  the  value  of  the  second  system.  The  first  row  shows  that  from  the 
time  perspective  the  behavior  of  P  doesn’t  change.  The  second  row  shows 
the  relative  change  of  the  perspectives.  The  third  row  depicts  Px,Py  and 
Pz. 

Although  this  aspect  of  RC  values  may  seem  strange,  it  is  actually  in¬ 
evitable.  After  all,  everything  is  relative  to  one’s  perspective.  Imagine  a 
machine  which  hourly  logs  the  linearly  increasing  concentration  of  alcohol  in 
a  fermentation  tank.  It  produces  the  following  sequence  of  measurements: 
0.02,  0.04,  0.06,  0.08,  etc.  But  in  the  identical  tank  nearby,  the  logging 
machine  has  a  defective  motor  which  runs  too  slowly  and  delays  the  mea¬ 
surements.  Although  the  fermentation  is  proceeding  at  the  same  pace  in  both 
tanks,  the  second  log  will  read:  0.03,  0.06,  0.09,  0.12,  etc.  Thus  the  plant 
inspector,  who  only  sees  the  alcohol-time  curve  from  the  perspective  of  the 
logging  device,  might  think  that  second  tank  was  fermenting  more  quickly 
even  though  the  only  real  change  was  a  slowdown  in  the  speed  of  the  timing 
motor. 


Figure  2.1:  PftJ,  1(  yetP\\[0  l)  andPtyfo  t) 


2.2.2  Derivative  Rules 

These  rules  connect  parameters  that  are  time  derivatives.  The  first  works 
over  intervals  and  the  second  predicts  RC  values  at  interval  endpoints.  The 
intuition  behind  the  first  is:  if  a  parameter  is  jj  at  the  start  of  an  interval, 
but  its  derivative  is  (1  over  the  interval,  then  the  parameter  must  be  over 
the  interval.  As  always,  the  ubiquity  of  perspectives  complicates  the  matter. 
Note  the  special  role  of  X  both  as  perspective  and  second  integrand  of  A. 

Proposition  3  Interval  Derivative  Rule 

Let  A,  V ,jund  X  be  parameters  such  that  A  —  -jtV ,  V  =  ^  X ,  and  X  is  a 
partial  perspective  over  (7i,7i+i).  Furthermore  let  A  and  V  be  positive  over 
the  interval  If  X \\it  ->1^,  AUf,  and  All*t+1).  Then  Vll£,+1). 

Proof:  The  chain  rule  makes  this  rule  considerably  harder  to  prove  than  the 
duration  rule.  It  suffices  to  show  that  there  exists  some  position  such  that 
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\V\  <  V  for  all  positions  up  to  and  including  this  position.  Once  it  is  known 
that  V  goes  down,  the  same  argument  can  be  used  to  show  that  it  continues 
to  go  down.  Thus  it  will  stay  down  until  7,+i  is  reached. 

Let 


v  dt 

t{x)  =  — 


1 


dx  V(X-»(aj)) 


Let 


f(x)  = 


d2t 


dx2 


A  can  be  expressed  as  a  function  of  X 
-f(x) 


A(A'_1(x))  = 


(f(x))3 


Because  X||;,  X(T( 7^))  =  X(T(^i))  =  a.  Since  and  A1J*  t+1),  it  is  the 
case  that  for  all  x  in  the  half  open  interval  [a,  b) 


r(x) 


> 


f(x) 


(r(x))3  (r(x))3 

Because  and  since  V  is  positive, 

f(a)  >  T(a)  >  0 

Substituting  (2.2)  in  the  denominator  of  (2.1)  gives 


(2.1) 


(2.2) 


r(a)  f(a) 


> 


>  — 


r(a) 


(f(a))3  -  (f(a))3  -  (f(a)) 


So 


f(a)  >  f(a) 


(2.3) 


And  by  continuity,  equation  (2.3)  holds  over  a  half  open  interval  which  may 
be  written  as  [o,c)  for  some  c.  This  implies  that  the  equation  holds  over  the 
closed  interval  [a,d]  where  d  =  a  +  -j5.  But  by  the  definition  of  f,  for  any 
x0  €  [a,d\ 
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Thus  by  the  definition  of  f,  for  all  x  G  (a,d] 

v(^-1(*))  <  nx-x(x)) 

so  □ 

Above  I  pointed  out  the  special  role  of  X  both  as  perspective  and  second 
integrand  of  A.  It  is  natural  to  ask  if  the  interval  derivative  rule  is  true 
for  arbitrary  perspectives.  Unfortunately,  it  is  not.  Appendix  B  provides  a 
counter-example  which  makes  this  point. 

The  interval  derivative  rule  has  an  important  corollary  which  predicts  the 
value  of  the  middle  derivative,  V ,  at  the  transition  ending  the  interval.  The 
intuition  is  twofold: 

•  If  the  object  is  accelerating  slower,  then  its  terminal  velocity  will  be 
smaller. 

•  If  the  object  accelerates  for  a  shorter  distance,  then  it  will  finish  going 
slower. 

Proposition  4  Transition  Derivative  Rules 

Let  A,  V,  and  X  be  parameters  such  that  A  —  ^  V,  V  =  X ,  X  is  a  partial 
perspective  over  (7,,7;+i),  and  both  A  and  V  are  positive  over  the  interval. 
If  one  of  the  following  conditions  is  true, 

•  Alj,  and  AIJ.*t+1)j  and  -nVft,-  and  DISTANCE-BYX||(j  .+1) 

•  and  DISTANCE-BYXlj^  i+1j  and  and  A||*l+1) 

then  V-0-i+1. 

The  rule  is  quite  a  mouthful,  but  that  is  simply  because  it  is  very  general. 


2.2.3  Perspective  Rules 

These  rules  deal  with  establishing  RC  values  for  perspectives  and  switching 
between  them.  The  first  is  very  simple,  but  turns  out  to  be  quite  important. 
The  intuition  is  that  if  the  plant  manager  was  foolish  enough  to  try  and  use 
the  logging  devices  to  log  their  own  speed,  he  wouldn’t  get  a  useful  result. 
Both  the  normal  and  slow  machines  would  record  that  they  turned  one  full 
revolution  during  each  revolution  of  the  timing  motor. 

Proposition  5  Self  Reference  Rule 

For  any  parameter  P ,  if  P  is  a  partial  perspective  over  (7;,  7i+1 )  then  P||,{ii-+1j. 

The  perspective  flipping  rules  switches  between  perspectives.  The  in¬ 
tuition  is  that  flipping  perspectives  (i.e.,  Xp  to  Px)  flips  1)  to  U  if  both 
parameters  are  positive  and  increasing  over  the  interval. 

Proposition  6  Perspective  Flipping  Rule 

If  the  parameters  X  and  P  are  covering  perspectives  over  (7,,7,+1),  the  sign 
of  X  equals  the  sign  of  P  over  the  interval ,  and  then: 

P1\L+i)  ifQDIR(X,T(lx),T{li+l))±  QDIR(P,T(lt),T(lt+l)) 
n£,+i)  ifQDIR(X,T(li),T(li+l))=  (?Z?/R(P,T(7.),T(7t+1)) 

If  the  sign  of  X  is  the  opposite  of  the  sign  of  P  then  the  RC  values  are 
reversed. 

Proof:  I  will  prove  the  case  where  both  X  and  P  are  increasing;  the  other 
cases  are  almost  identical.  Let  a  —  X(T(~fi)),  and  b  =  X{T(~ji+i)).  For  an 
arbitrary  x  £  (a, 6)  3p  such  that  X(P-1(p))  =  x  because  P  is  a  covering 
perspective,  and  thus  onto.  Let  t\  =  P~l{p ),  and  let 

x  =  X(t1)  =  X(P-1(p) 

By  the  definition  of  -XTrfi.i+i)  it  follows  that  x  >  x.  Let  t0  =  X-1(x).  Since 
X  is  increasing  to  <  t\.  Again  because  P  is  onto,  3p  such  that  P~l(p )  =  t0 
so  X{P~l(p))  =  x.  Now,  p  <  p  because 

P~l(p)  =  to<h  =  P~\p ) 
and  P  is  increasing.  But  this  means  that 
P(X-l(x))<  P(X~l(x)) 

and  since  x  was  arbitrary,  it  follows  that  Pit*  j+i)  d 


2.2.4  Constants 

Frequently  a  system  will  contain  a  few  constant  parameters  whose  values 
never  change.  The  following  rules  are  a  simple  way  to  express  relationships 
between  constants  in  the  notation  of  comparative  analysis.  The  intuition 
is  that  since  perspectives  just  scale  time,  and  constants  don’t  change  over 
time,  all  perspectives  agree  on  the  behavior  of  constants.  If  there  was  no 
fermentation  happening  in  either  vat  (i.e.  the  alcohol  concentration  was 
constant  in  both  vats),  and  the  concentration  of  alcohol  was  higher  in  vat 
two,  then  both  logging  devices  would  agree  on  this  even  though  their  timing 
motors  differed. 

Proposition  7  Transition  Constant  Rule 

If  a  parameter  K  is  a  constant  over  (7i,7,+i),  and  A’fl'i  then  K{\i+1. 

Proposition  8  Interval  Constant  Rule 

If  a  parameter  K  is  a  constant  oner  (7^7,4.  i),  and  then  for  all  parameters 

P,  if  P  is  a  partial  perspective  over  the  interval  (7,-,  7;+1),  then  A'ff£1  +  1). 

2.2.5  Rules  with  Time  as  a  Perspective 

It  is  very  common  for  one  parameter  to  be  the  derivative  of  another  with 
respect  to  time.  When  it  is  possible  to  reason  about  these  relations  from  the 
perspective  of  time,  greater  power  is  achieved  because  the  chain  rule  doesn’t 
interfere  as  it  does  in  the  derivative  rule.  The  only  drawback  is  the  fact  that 
these  rules  are  less  frequently  applicable. 

The  first  rule  says  that  if  the  a  parameter  is  ||from  the  perspective  of 
time,  and  the  duration  of  the  interval  is  increasing,  then  the  parameter  will 
have  changed  more  by  the  end  of  the  interval. 

Proposition  9  The  End  of  Time  Rule 

T 

Let  X  be  a  parameter  such  that  AT||-  and  X||^ii+1).  Let  s  be  the  sign  of  X 
over  the  transition  interval  (7;,7i+i)  and  d  be  the  sign  of  X ’s  derivative.  If 
the  duration  0/(7;,  7, +  1)  is  If ,  then 

X||-  if  d  =  0,  otherwise 
Xi\i  if  s  =  d 
Xll,  tfs^d 


B 


ass 

M 


v.’W 


The  proof  of  this  lemma  is  trivial  and  thus  omitted,  but  it  should  be 
noted  that  it  is  easier  to  express  using  signed  semantics.  The  second  rule  is 
used  for  determining  a  parameter  RC  value  from  the  perspective  of  time.  It 
applies  whenever  the  time  derivative  of  a  parameter  is  a  linear  function  of 
the  parameter. 

Proposition  10  One’s  Own  Derivative  Rule 

Let  X,  V,  and  K  be  parameters  such  that  V  =  X,  V  =  MULT(X,  K),  and 

'T  'J~ 

K  is  a  negative  constant.  IfV(T( 7,))  7^  0  and  |t  and  AT^t-i+1j  then  i+1j. 

2.2.6  Rules  from  Qualitative  Arithmetic 

Research  in  qualitative  simulation  [8,16,49,27]  has  developed  constraints  on 
derivative  values  for  parameters  in  ADD,  MULT,  and  monotonic  function  con¬ 
straints.  For  example,  if  X  x  Y  =  Z  and  the  derivatives  of  X  and  Y  are 
positive,  then  Z  must  have  positive  derivative  as  well.  These  rules  can  be 
generalized  to  include  RC  values  at  transition  points  and  over  intervals.  Here, 
I  present  just  the  rule  for  a  MULT  constraint  at  a  transition  point. 

Proposition  11  Multiplication  Rule 

If  X,  Y ,  and  Z  are  parameters  which  are  related  by  the  constraint,  Z  = 
MULT(X,F),  then  the  following  table  displays  the  possible  RC  values  for  Z 
at  a  transition  point: 

Y 

ft,  II,  ft, 

ft,  ft,  ft,  ? 

X  II,  ft,  II,  ft, 

ft,  ?  ft,  ft, 

The  rule  for  the  ADD  constraint  is  similar,  but  complex  to  write  using 
magnitude  semantics. 

2.3  Implementation 

To  test  the  theory  of  DQ  analysis,  a  program  called  CA  has  been  written  on 
a  Symbolics  lisp  machine.  When  a  user  selects  an  example,  CA  runs  QSIM 


[27]  on  the  example  to  produce  a  set  of  qualitative  behaviors  for  the  example. 
The  user  selects  a  behavior  and  also  a  set  of  initial  RC  perturbations.  CA 
translates  the  QSIM  behavior  and  perturbations  into  ARK4  assertions.  At 
this  point  ARK  forward  chains  using  the  propositions  described  earlier  in 
this  section. 

Each  of  these  propositions  is  implemented  as  an  ARK  rule  or  more  than 
one  if  the  proposition  used  disjunction  or  negation.  For  example,  the  duration 
rule  (proposition  1)  is  encoded  as  the  three  ARK  rules  of  figure  2.2.  The 
various  definitions  and  propositions  require  about  sixty  ARK  rules. 

(=>  (AND  (d/dt  ?x  ?v)  ;  ?v  is  the  derivative  of  ?x 

(DISTANCE-BY  ?x  (?start  ?end)  deq)  ;  ?x  travels  the  same  distance 
(RC  ?v  (?start  ?end)  ?c  (P-  ?x))  ;  the  RC  of  ?v  is  ?c  from 

(OPPOSITE-RC  ?c  ?oc))  ;  the  partial  persp.  of  ?x 

(DURATION  (?start  ?end)  ?oc)  ;  if  ?c  is  ft,  ?oc  is  ft 

duration-rulel) 

(=>  (and  (d/dt  ?X  ?v) 

(DISTANCE~BY  ?x  (?st art  ?end)  ?oc)  ;  if  ?x  travels  ?oc  distance 
(rc  ?v  (?start  ?end)  ?c  (P-  ?x))  ;  and  V’s  RC  agrees 

(OPPOSITE-RC  ?c  ?oc ) ) 

(DURATION  (?start  ?end)  ?oc)  ;  then  the  duration  is  ?oc 

duration-rule2) 

(=>  (AND  (d/dt  ? X  ?v) 

(DISTANCE-BY  ?x  (?start  ?end)  ?oc)  ;  if  ?x  travels  ‘less’  distance 
(RC  ?v  (?start  ?end)  deq  (P-  ?x)))  ;  and  V  doesn’t  change 

(DURATION  (?start  ?end)  ?oc)  ;  then  the  duration  is  ‘less’ 

duration-rule3) 

Figure  2.2:  Propositions  Are  Encoded  Directly  Into  ARK  Rules 

The  simplicity  of  the  transformation  from  proposition  to  ARK  code  pro¬ 
vides  confidence  in  the  soundness  of  the  implementation.  And  the  fact  that 

4ARK  is  a  descendant  of  AMORD  [9]  implemented  by  Howie  Shrobe  and  others. 


most  rules  get  used  in  each  explanation,  establishes  their  utility. 

Since  ARK  maintains  justifications  for  all  its  assertions,  it  is  possible 
to  generate  explanations  for  CA’s  conclusions.  Consider  the  spring/block 
example.  The  question  here  is:  “What  happens  to  the  period  of  spring 
oscillation  if  the  mass  of  the  block  is  increased?”  The  system  is  defined  in 
terms  of  six  parameters:  spring  constant  K ,  mass  M,  position  X,  velocity 
V ,  acceleration  A,  and  force  F  obeying  the  following  equations: 


F  =  MULt(A/,A) 

F  =  mult(AT,  X) 

M  —  std 
jt  K  =  std 

The  initial  conditions  are  specified  as  follows:  M( 0)  >  0,  A'(0)  <  0,  CfO)  = 
0,  and  X(0)  =  x0  <  0.  Since  energy  conservation  is  not  made  explicit  in 
the  equations,  QSIM  produces  several  possible  behaviors  for  this  system. 
Although  comparative  analysis  could  be  done  on  any  of  the  behaviors,  I  as¬ 
sume  in  this  example  that  the  user  selects  the  interpretation  corresponding 
to  stable  oscillation. 

Now  the  user  selects  the  perturbation.  Because  some  parameters  depend 
on  one  another,  not  all  parameters  may  be  perturbed.  The  situation  is  analo¬ 
gous  to  the  problem  of  specifying  a  unique  solution  to  a  differential  equation 
where  values  must  be  given  for  the  independent  parameters  and  a  set  of 
boundary  conditions  provided.  In  this  example,  M  and  K  are  independent, 
while  values  for  X  and  V  are  needed  as  boundary  conditions.  Thus  to  specify 
a  comparative  analysis  problem,  these  four  parameters  need  to  be  given  ini¬ 
tial  RC  values.5  For  this  example,  the  perturbation  consists  of  the  following 
initial  RC  values:  A/ff0,  Aj|0,  V ||0,  and  Af||0. 

5The  choice  of  these  four  parameters  is  somewhat  arbitrary.  Mathematically,  it  would 
be  equally  reasonable  to  choose  A  instead  of  X,  but  this  does  not  make  physical  sense;  it 
seems  intuitively  impossible  to  directly  affect  acceleration.  Since  there  is  no  way  to  deduce 
this  from  the  differential  equation  model,  it  is  essential  for  the  person  who  constructs  the 
model  to  annotate  the  structural  description  with  the  list  of ‘causally  primitive'  parameters 
—  in  this  case,  the  four  listed  above. 


Given  this  input,  CA  correctly  deduces  that  the  block  will  take  longer 
to  reach  the  rest  position  ( X  =  0)  from  its  original  negative  stretched  po¬ 
sition.  Figure  2.3  shows  the  explanation  that  CA  generates;  this  is  created 
by  throwing  away  all  perspective  information  once  computation  is  finished. 
I  have  annotated  the  explanation  with  the  names  of  rules  used  in  each  step. 


Assuming  M  is  increased: 
X  doesn’t  change  and 
K  doesn’t  change  and 
F  equals  K  times  X 
So  F  doesn’t  change. 

and 


(self- reference  rule) 
(interval  constant  rule) 

(multiplication  rule) 


M  increases  and 
F  equals  M  times  A 
So  A  decreases. 

So  V  decreases. 

So  the  time  duration 


(interval  constant  rule) 

(multiplication  rule ) 
(derivative  rule) 
increases,  (duration  rule) 


Figure  2.3:  CA  Generated  Explanation  for  Spring  with  Heavier  Block 

Since  it  is  an  initial  prototype,  CA  makes  no  use  of  control  rules.  All  pos¬ 
sible  forward  chaining  inferences  are  made  using  every  possible  perspective. 
Despite  this,  computation  rarely  exceeds  a  minute  on  any  of  the  problems 
tested.  If  larger  problems  were  to  be  attempted,  some  form  of  control  would 
be  desirable.  Backward  chaining  from  a  goal  pattern  might  increase  effi¬ 
ciency.  There  appears  to  be  no  reason  why  the  schemes  of  [11,46]  could  not 
be  applied.  Possible  heuristics  include  preferential  investigation  of  certain 
perspectives  and  avoidance  of  certain  computationally  explosive  rules  like 
the  perspective-flip  rule. 

Another  technique  tcrspeed  up  reasoning  is  explanation  based  generaliza¬ 
tion  [29,13].  Following  the  approach  of  [24],  I  implemented  a  postprocessing 
learning  routine  that  takes  CA  explanations  and  produces  new  ARK  rules 
which  may  be  added  to  the  ones  presented  above.  While  these  new  rules 
are  independent  of  any  particular  domain  (i.e.,  springs),  they  are  optimized 
to  solve  a  specific  class  of  comparative  analysis  problems.  Less  general  than 
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the  rules  presented  above,  the  new  rules  are  considerably  more  general  than 
the  specific  explanation  from  which  they  are  derived.  Although  I  have  com¬ 
pleted  the  EBG  implementation,  the  empirical  evaluation  of  EBG’s  ability 
to  increase  DQ  processing  efficiency  remains  as  an  area  for  future  research. 

At  present  CA  has  been  tested  for  multiple  perturbations  on  over  fifty 
comparative  analysis  problems  using  over  twenty  models  (appendix  F).  While 
it  always  terminates  and  never  produces  an  incorrect  answer,  CA  doesn’t  nec¬ 
essarily  deduce  RC  values  for  every  parameter.  Section  4  explains  how  this 
is  a  limitation  of  the  DQ  analysis  technique  independent  of  the  CA  imple¬ 
mentation. 

2.4  Extensions  for  Diagnosis 

A  natural  application  for  comparative  analysis  is  the  automated  diagnosis  of 
continuous  devices  such  as  analog  electronic  circuits.  Generate  and  test  is  a 
standard  paradigm  for  hardware  diagnosis  [19]:  candidate  faults  are  proposed 
then  evaluated  to  see  if  they  account  for  the  faulty  measurements.  Like  all 
forms  of  comparative  analysis,  DQ  analysis  can  be  used  to  test  any  candidate 
faults  that  can  be  described  as  perturbations  of  continuous  parameters  in 
the  device.  In  addition,  however,  DQ  analysis  has  the  potential  to  generate 
classes  of  candidate  faults.  The  key  is  to  run  the  DQ  inference  rules  in 
reverse.  For  example,  the  duration  rule  says: 

Proposition  1  Duration  Rule 

Let  V  and  X  be  parameters  such  that  X  is  a  partial  perspective  over  (7,,7i+1). 
Given  V  =  ^X,  and  ~'DISTANCE-BYX(L(Iii+i)  then  the  duration  of 

(7i,7m)  will  incrtase. 

A  natural  question  is  “Can  the  duration  rule  be  reversed?  Is  the  converse 
sound?” 

Conjecture  12  Converse  Duration  Rule 

Let  V  and  X  be  parameters.  Given  V  =  ~  X  and  -’DISTANCE-BYXIi(,il+Ij. 
If  the  duration  of  ( 7,,7.+i)  fl>  then 

Unfortunately,  the  converse  is  false,  as  are  the  converses  for  other  impor¬ 
tant  rules  such  as  the  various  derivative  rules.  The  problem  results  from  an 
implicit  closed  world  assumption  used  in  reversing  the  rule — that  one  of  the 


three  RC  values,  ft,  ft,  or  |j,  always  applies.  Proposition  21  showed  that  this 
was  false. 

Of  course  every  transition  interval  could  be  broken  into  pieces  such  that  a 
single  RC  value  applies  over  each  piece,  but  this  misses  the  fundamental  issue. 
The  decomposition  of  time  into  transition  intervals  is  forced  by  behavior  of 
the  system.  Thus  transition  intervals  have  genuine  qualitative  importance. 
While  sometimes  useful,  decomposing  transition  intervals  into  smaller  pieces 
runs  the  risk  of  introducing  irrelevant  distinctions. 

Although  the  converse  of  the  duration  rule  is  not  sound,  its  converse  might 
still  be  profitably  used  as  a  heuristic  candidate  generator.  By  reversing  the 
DQ  inference  rules,  it  may  be  possible  to  provide  focus  to  the  search  for 
probably  faults  in  misbehaving  analog  circuitry. 

2.5  Changes  in  Behavioral  Topology 

Recall  that  the  inference  rules  of  section  2.2  relied  on  the  assumption  that 
the  perturbed  behavior  was  topologically  equal  (definition  8)  to  the  initial 
behavior.  In  other  words,  it  was  assumed  that  while  the  perturbation  might 
change  the  relative  values  of  parameters  and  stretch  or  shrink  the  length 
of  time  intervals,  the  underlying  sequence  of  transitions  would  not  change. 
Yet  perturbations  often  will  change  the  order  or  nature  of  transitions.  This 
section  explains  how  to  recognize  the  changes  and  predict  the  resulting  be¬ 
havior.  The  overall  architecture  (figure  2.4)  is  an  extension  of  the  flowchart 
shown  earlier  (figure  1.2).  The  topology  checker  verifies  the  consistency  of 
the  predictions  made  by  the  constraint  propagator.  Since  the  inference  rules 
are  sound,  any  inconsistency  must  be  caused  by  a  violation  of  the  topological 
equality  assumption.  A  simple  graph  search  technique  locates  the  trouble¬ 
some  transition  and  determines  the  correct  behavior. 

To  illustrate  these  computations,  I  use  the  simple  example  of  the  heat 
exchanger  (figure  1.5)  from  section  1.5.2.  This  system  is  described  in  terms 
of  five  parameters,  each  a  function  of  time:  heat  Q,  heat  flow  F ,  thermal 
conductivity  K,  velocity  of  the  liquid  through  the  pipe  V,  and  position  of  a 
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Figure  2.4:  Overview  of  the  DQ  Analysis  Algorithm 
unit  volume  of  oil6  X .  The  following  equations  are  obeyed:7 


V  ~  -  X 

v  dt 


F  =  mult(C?,/0  (2.4) 

In  addition  V  and  K  are  considered  independent  and  assumed  constant 
over  time.  The  initial  conditions  specify  the  value  for  the  independent  pa¬ 
rameters:  F(0)  >  0  and  A’(O)  <  0,  and  also  the  boundary  conditions: 

6For  simplicity,  the  simplistic  ‘liquid-individual’  model  of  fluids  is  used  here;  see  [20] 
for  a  discussion  of  the  problems  with  this  model. 

7For  simplicity,  this  model  does  not  distinguish  between  temperature  and  heat. 
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.A(O)  =  Xq  <  0  and  <5(0)  =  q0  >  0.  From  this  information  the  initial 
value  of  the  dependent  parameter,  F,  can  be  determined;  denote  F(0)  =  f0. 
An  invariant  specifying  that  X  must  always  be  less  than  or  equal  to  zero 
ends  the  simulation  when  the  liquid  individual  leaves  the  pipe. 

Given  this  description,  QSIM  (and  other  qualitative  simulators  [17])  pro¬ 
duces  the  tree  of  qualitative  states  (STATE  TREE)  shown  in  figure  2.5.  Since 
each  path  through  the  tree  is  a  topologically  distinct  behavior,  this  tree  rep¬ 
resents  three  possible  behaviors  for  the  heat  exchanger.  The  topmost  path 
(QS1,  QS2,  QS3)  corresponds  to  the  behavior  of  figure  2.6  in  which  the  sys¬ 
tem  reaches  thermal  equilibrium  just  as  the  oil  leaves  the  exchanger. 


(%’%)  \  (%■%)  12 


Figure  2.5:  QSIM  State  Tree  Generates  Possible  Behaviors 

Because  of  its  qualitative  representations,  QSIM  cannot  choose  between 
the  different  behaviors  for  the  heat  exchanger;  as  far  as  QSIM  is  concerned, 
they  are  all  plausible.  Since  DQ  analysis  works  relative  to  a  single  behavior, 
one  path  through  the  tree  must  be  chosen  before  running  the  rules  of  section 
2.2.  This  selection  of  a  behavior  is  a  modeling  decision;  I  assume  that  it  is 
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Figure  2.6:  Initial  Behavior  Corresponding  to  Path  (QS1,  QS2,  QS3) 

done  by  a  human.  The  selection  consists  of  a  series  of  choices  at  each  branch 
in  the  tree.  By  ruling  out  possible  behaviors,  each  choice  implicitly  constrains 
the  model  of  the  system,  restricting  the  possible  real  values  associated  with 
the  qualitative  values  of  each  parameter.  Thus  the  selection  of  behavior 
(QS1,  QS2,  QS3)  makes  implicit  assumptions  about  the  relative  values  of 
fluid  velocity,  V ,  and  thermal  conductivity,  K. 

These  implicit  constraints  are  equivalent  to  the  unambiguous  selection 
of  the  initial  behavior.  However,  the  comparative  analysis  perturbation  can 
weaken  the  balance  of  constraint  in  two  ways: 

•  The  initial  behavior  can  be  rendered  inconsistent.  Section  2.5.1  explains 
how  the  conflict  is  recognized  and  a  new,  consistent  path  is  found. 

•  Alternate  behaviors  may  become  consistent.  Section  2.5.2  explains  how 
to  locate  other  consistent  paths  through  the  state  tree. 
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2.5.1  Initial  Behavior  Inconsistent 


Suppose  someone  selected  the  path  (QS1,  QS2,  QS3)  as  the  heat  exchanger’s 
initial  behavior  (figure  2.6)  and  chose  the  perturbation  Kf\.  The  state  QS3 
dictates  the  two  transitions,  Q  reaching  zero  and  X  reaching  zero,  in  the  same 
time  instant.  Since  the  perturbation  causes  heat  to  be  lost  more  rapidly,  QS3 
can’t  be  part  of  the  final  behavior.  If  one  assumes  that  it  is,  the  duration 
rule  (section  2.2.1)  deduces  a  contradiction,  as  follows. 

When  it  follows  that  Thus  the  duration  until  the  first  tran¬ 

sition  is  J j..  However,  being  a  constant  V  is  unchanged  by  the  perturbation, 
so  1^11(0  1);  the  duration  rule  uses  this  fact  to  conclude  that  the  duration 
((.  Hence  the  conflict.  The  perturbation  causes  heat  to  reach  its  transition 
quicker,  but  position  is  unaffected  and  will  transition  at  the  same  time. 

Behavioral  inconsistencies  are  located  by  stepping  through  the  transition 
intervals  from  earliest  on,  and  checking  the  RC  values  for  the  interval’s  du¬ 
ration.  Section  2.5.1  explains  how  to  find  all  behaviors  that  avoid  this  single 
contradiction  while  obeying  the  initial  constraints.  Section  2.5.1  provides 
heuristics  for  eliminating  inferior  paths.  Finally,  section  2.5.1  shows  how  to 
check  if  the  new  behavior  is  globally  consistent,  not  just  a  fix  to  the  first 
contradiction.  Note  that  all  of  these  techniques  depend  on  the  DQ  infer¬ 
ence  rules  which  are  incomplete.  As  a  result,  while  most  inconsistencies  are 
detected,  it  is  not  guaranteed  that  all  inconsistencies  can  be  found. 

Finding  Consistent  Alternatives 

A  simple  observation  about  the  inference  rules  of  section  2.2  forms  the  foun¬ 
dation  for  the  contradiction  resolution  method:  only  the  duration  rule  can 
generate  an  RC  value  for  a  time  duration.  Therefore,  the  contradiction  must 
be  caused  by  two  (or  more)  firings  of  the  duration  rule  for  the  same  interval. 
What  distinguishes  these  firings  are  the  different  perspective  parameters  used 
in  each  application  of  the  rule. 

In  the  heat  exchanger  example,  the  two  perspective  parameters  are  Q 
and  X.  In  the  initial  behavior,  they  reached  transitions  in  the  same  state, 
QS3.  But  to  achieve  consistency  with  the  perturbation,  we  must  find  a 
behavior  where  they  reach  transitions  independently.  This  means  finding  a 
path  which  starts  with  QSl  and  QS2,  and  passes  through  a  sibling  of  QS3. 

8By  the  interval  constant  rule,  the  self  reference  rule  and  the  multiplication  rule. 


The  answer,  of  course,  is  the  path  (QS1,  QS2,  QS5,  QS6,  QS7)  as  shown 
in  figure  2.7.  This  path  illustrates  the  general  case.  A  node  representing 
the  qualitative  state  at  a  time  point  (QS3)  is  replaced  by  three  states:  two 
at  time  points  (QS5,  QS7)  and  one  for  the  interval  connecting  them  (QS6). 
For  the  purpose  of  discussion,  I  shall  call  QS3  the  FRAGMENTING  POINT 
and  the  two  time-point  states  which  define  our  objective,  the  PREPOINT  and 
POSTPOINT  respectively.9 


Figure  2.7:  The  Behavior  Corresponding  to  Path  (QSl,  QS2,  QS5,  QS6, 
QS7) 

9ActuaUy,  this  discussion  assumes  a  simplified  version  of  the  general  problem.  I  assume 
that  the  contradiction  is  caused  by  only  two  firings  of  the  duration  rule,  and  I  assume  that 
at  the  contradiction  can  be  resolved  by  the  addition  of  a  single  new  transition.  The  general 
case  is  a  straightforward  extension.  If  the  QS2  interval  had  three  conflicting  duration  RC 
values,  ||,  and  1),  then  QS3  could  split  into  five  states:  three  for  time  points  and 
two  connecting  intervals.  If  multiple  rule  firings  are  allowed  for  each  RC  value,  then 
correspondingly  more  paths  are  possible. 
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The  problem,  then,  is  to  search  the  state  tree  among  the  siblings  of  the 
fragmenting  point  to  find  the  pre-  and  postpoint  states.  We  know  that  Q 
and  X  must  reach  transitions  in  different  states,  but  which  should  reach 
its  transition  first?  Consider  the  two  duration  RC  values  which  cause  the 
contradiction.  Since  1J.  specifies  earlier  termination  than  ||,  Q,  the  perspective 
parameter  for  the  firing  which  produced  the  ^  value,  will  reach  its  transition 
first.  This  means  that  the  prepoint  will  have  Q  =  0  and  not  X  -  0  Since 
QS5  is  the  only  state  to  meet  this  requirement,  so  QS5  is  the  prepoint.  For 
the  heat  exchanger  example,  this  state  uniquely  defines  the  new  behavior, 
because  only  one  path  includes  QS5;  hence  QS7  must  be  the  postpoint.  In 
a  more  complex  example,  however,  there  could  be  several  candidates  for 
prepoint  and  multiple  behaviors  passing  through  each  one.  The  following 
conditions  further  restrict  the  possibilities. 

•  All  parameters  that  reach  transitions  in  the  prepoint,  must  have  reached 
transitions  in  the  fragmenting  point. 

•  All  parameters  that  reach  transitions  in  the  postpoint,  must  have  reached 
transitions  in  the  fragmenting  point. 

•  All  parameters  that  reached  transitions  in  the  fragmenting  point  must 
reach  transitions  in  either  the  prepoint  or  the  postpoint,  but  not  both. 

While  these  conditions  are  loyal  to  the  implicit  constraints  resulting  from 
the  initial  selection  of  behavior,  they  are  unfortunately  not  sufficient  to  guar¬ 
antee  a  unique  alternate  behavior.  The  next  section  explains  a  heuristic  that 
will  guarantee  a  unique  behavior  but  does  not  necessarily  obey  all  implicit 
constraints. 

A  Heuristic  For  Eliminating  Behaviors 

The  conditions  listed  above  produce  a  unique  behavior  except  in  cases  where 
additional  parameters  besides  Q  and  X  reach  transitions  in  the  fragmenting 
point.  When  extra  parameters  reach  transitions  in  the  fragmenting-point,  one 
must  choose  where  they  should  transition — in  the  prepoint  or  the  postpoint. 
The  following  cases  result: 
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•  The  parameter  could  be  causally  connected  to  either  Q  or  X.  In  fact, 
this  is  the  case  with  the  heat  exchanger:  F  transitions  to  zero  in  QS3. 
How  did  we  know  that  F  should  reach  its  transition  in  the  prepoint 
rather  than  the  postpoint?  We  didn’t  even  need  to  consider  the  ques¬ 
tion.  By  constructing  the  state  tree,  QSIM  already  handled  the  problem 
for  use.  It  recognized  that  F  must  transition  whenever  Q  transitioned; 
thus  the  state  tree  contains  only  this  possibility.  Since  the  topological 
consistency  code  searches  the  state  tree,  it  automatically  benefits  from 
QSIM’s  work. 

•  There  could  be  additional  RC  information  about  the  parameter.  For 
simplicity,  this  case  was  not  discussed  above,  but  suppose  that  the 
duration  rule  had  fired  three  times  with  Q,  X,  and  S  as  perspectives.  If 
5  and  X  both  caused  the  duration  rule  to  deduce  an  RC  value  of  ||,  then 
both  X  and  5  should  reach  transitions  in  the  postpoint.  Unfortunately, 
other  RC  values  complicate  the  analysis.  If  three  different  RC  values 
result  from  the  three  firings,  then  the  fragmenting  point  will  split  into 
five  states.  The  details  are  messy,  but  the  concepts  for  resolution  are 
similar  to  those  described  above. 

•  The  parameter  could  be  independent  of  the  perturbation  without  the 
inference  rules  deducing  this.  As  with  the  previous  case  (where  the  in¬ 
dependence,  duration  ||,  was  deduced)  the  parameter  should  transition 
in  whichever  state  has  duration  |[. 

•  The  perturbation  could  change  the  parameter’s  transition  time  with¬ 
out  the  inference  rules  deducing  this.  The  correct  behavior  is  not  pre¬ 
dictable  since  the  change  in  duration  is  not  known. 

Since  there  is  no  way  to  correctly  handle  the  last  case,  a  reasonable  heuris¬ 
tic  is  to  assume  that  it  never  happens.  This  corresponds  to  Occam’s  Razor. 
Assume  that  unless  the  duration  rule  says  otherwise,  the  perturbation  does 
not  change  the  transition  time  of  any  parameters.  Thus  if  the  heat  exchanger 
example  had  an  extra  parameter,  5,  which  reached  a  transition  in  QS3,  then 
we  should  assume  that  5  transitions  with  X  in  QS7. 
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Ensuring  Global  Consistency 

Using  the  heuristics,  the  algorithm  described  above  is  guaranteed  to  find 
a  unique  postpoint.  But  there  may  be  several  state  tree  paths  that  pass 
through  this  post  point.  To  locate  a  single  new  behavior,  the  program  must 
step  through  the  original  behavior  from  the  fragmenting  point  onwards.  Ev¬ 
ery  time  a  branch  in  the  tree  is  taken,  the  corresponding  descendant  of  the 
postpoint  should  be  selected  as  well.  When  the  original  behavior  reaches  a 
leaf,  a  unique  new  behavior  will  result.  Unfortunately,  there  are  two  reasons 
why  processing  must  continue. 

•  Many  RC  values  must  be  recomputed.  Because  the  RC  values  refer  to 
transition  points  and  intervals,  all  values  from  the  fragmenting  interval 
onward  will  be  incorrect.  This  isn’t  very  surprising;  after  all,  we  started 
with  conflicting  duration  RC  values  in  the  first  place.  Given  the  new 
behavior,  the  inference  rules  of  section  2.2  must  be  rerun  to  generate  a 
consistent  set  of  RC  values. 

•  What  if  these  rules  generate  a  new  contradiction?  There  is  no  guarantee 
that  the  new  behavior  is  topologically  sound.  However,  if  conflicting 
duration  RC  values  are  generated  for  an  interval,  that  interval  must 
occur  after  any  interval  which  caused  a  previous  conflict.  Thus  each 
cycle  of  inference  rules  and  topology  resolution  guarantees  that  the  time 
of  first  inconsistency  increases.  Since  all  behaviors  are  finite,  the  cycle 
must  eventually  terminate. 

It  is  possible  that  a  more  sophisticated  algorithm  could  eliminate  this 
cyclic  approach  by  a  detailed  analysis  of  the  initial  behavior.  Since  all  param¬ 
eters  are  continuous  functions  of  time,  no  (small)  perturbation  can  invalidate 
the  initial  behavior  unless  the  behavior  has  a  state  in  which  two  parameters 
transition.  Perhaps  all  such  states  could  be  checked  at  once. 

2.5.2  Finding  Other  Consistent  Behaviors 

Sometimes  a  perturbation  will  be  consistent  with  the  initial  behavior,  i.e.  not 
violate  the  implicit  constraints,  but  will  weaken  them  instead.  In  other  words, 
there  may  be  several  behaviors  which  are  consistent  with  the  perturbed  initial 
behavior.  Since  the  QSIM  state  tree  records  the  results  of  past  transition 


analysis,  a  simple  search  technique  suffices  to  find  the  behaviors  that  are 
consistent  with  both  the  perturbation  and  the  implicit  constraints.  Four 
cases  need  to  be  checked:  compacting,  stalling,  kick-starting,  and  splitting. 

•  COMPACTING 

When  the  duration  of  an  interval  is  decreasing,  perhaps  the  states  on 
either  side  will  merge  into  a  single  transition.  Suppose  the  initial  be¬ 
havior  is  the  path  (QSl,  QS2,  QS5,  QS6,  QS7)  as  shown  in  2.7,  and 
suppose  the  perturbation  is  K\\-.  Although  the  initial  behavior  is  con¬ 
sistent  with  this  perturbation,  it  is  possible  that  thermal  equilibrium 
will  be  delayed  until  the  precise  moment  that  the  oil  leaves  the  pipe. 
This  would  correspond  to  the  behavior  (QSl,  QS2,  QS3)  as  shown  in 
figure  2.6.  Whenever  the  duration  of  an  interval  (e.g.,  QS6)  is  getting 
shorter,  CA  looks  for  an  uncle  state  which  has  the  same  transitions 
(i.e.  the  same  parameters  reaching  the  same  landmarks)  as  the  union 
of  the  parent  and  child  of  the  interval  state.  Q  and  F  reach  transitions 
in  QS5,  the  parent  of  QS6,  and  X  transitions  in  the  child  of  QS6.  So 
the  search  produces  the  uncle,  QS3,  and  constructs  the  corresponding 
path  through  it. 

•  STALLING 

If  the  duration  of  an  interval  is  f),  then  maybe  the  parameters  will  not 
transition  in  finite  time.  CA  suggests  a  behavior  consisting  of  the  path 
which  ends  at  the  interval  state. 

•  KICK-STARTING 

Kick  starting  is  the  inverse  of  stalling.  If  the  initial  behavior  ended 
with  a  terminal  interval,  and  the  perturbation  is  causing  the  interval’s 
duration  to  (1,  then  maybe  some  parameter  will  transition  in  finite  time. 
CA  returns  all  paths  that  pass  through  the  interval  state. 

•  SPLITTING 

Splitting  happens  when  the  duration  rule10  deduces  a  single  RC  value 
of  ff  or  (1  from  two  different  perspectives.  For  example,  consider  the 

10Splitting  is  the  only  case  that  analyzes  justifications  and  depends  on  the  fact  that  the 
duration  rule  is  the  only  way  to  generate  a  duration  RC  value.  Compacting,  stalling,  and 
kick-starting  only  require  the  RC  value  and  access  to  the  state  tree. 
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heat  exchange  with  an  initial  behavior  of  (QS1,  QS2,  QS3)  and  the 
perturbation  of  K§  and  V’ft.  Since  thermal  conductivity  is  higher, 
equilibrium  will  occur  sooner,  but  since  the  oil  is  moving  faster,  it  will 
get  out  quicker.  Both  parameters  lead  the  duration  rule  to  conclude 
QS3  will  occur  quicker;  thus  the  initial  behavior  is  consistent.  But  so  is 
every  behavior.  If  the  thermal  conductivity  is  much  higher  and  velocity 
is  only  a  little  higher,  then  the  behavior  (QS1,  QS2,  QS5,  QS6,  QS7) 
will  result.  If  V  was  increased  more  than  K  then  the  path  (QSl,  QS2, 
QS4)  would  result.  Because  the  perturbation  was  specified  in  qualita¬ 
tive  terms,  there  isn’t  enough  information  to  resolve  the  ambiguity  and 
CA  must  return  all  possible  splits  of  the  two  parameters  Q  and  X . 

Like  the  techniques  of  section  2.5.1,  my  methods  for  finding  other  consis¬ 
tent  behaviors  are  dependent  on  the  DQ  inference  rules.  As  a  result  they  are 
neither  complete  nor  sound.  For  example,  suppose  the  duration  of  an  interval 
was  1|,  but  the  duration  rule  had  not  deduced  this  fact.  Then  compaction 
would  not  be  considered  and  a  possibly  consistent  behavior  would  not  be 
considered.  Similarly,  one  of  the  techniques  could  suggest  a  behavior  which 
appears  consistent  only  because  the  DQ  rules  were  inadequate  to  expose  a 
contradiction. 


Chapter  3 
Exaggeration 


Exaggeration’s  approach  to  comparative  analysis  is  very  different  from  that 
of  DQ  analysis.  Instead  of  tracing  the  effect  of  a  perturbation  through  the 
causal  structure  of  the  system,  exaggeration  considers  the  behavior  of  a  sys¬ 
tem  in  which  the  perturbation  is  taken  to  a  limiting  value.  If  this  new  system 
has  qualitatively  different  behavior  than  the  original,  then  exaggeration  pos¬ 
tulates  a  general  trend  caused  by  the  perturbation.  For  example,  consider  the 
heat  exchanger  example  of  section  2.5  and  the  comparative  analysis  question 
‘What  would  happen  to  the  output  temperature  of  the  oil  if  it  moved  faster 
through  the  pipe?’  Exaggeration  produces  the  following  answer: 

If  the  oil  moved  infinitely  fast,  it  would  spend  almost  no  time 
in  the  exchanger.  Since  almost  no  heat  would  be  lost,  the  oil 
would  exit  very  hot.  Thus  increasing  the  fluid  flow  rate  a  small 
amount  should  increase  the  output  temperature  a  bit  as  well. 

Thus  exaggeration  changes  a  comparative  analysis  question  into  a  simula¬ 
tion  problem  about  a  system  with  infinite  or  infinitesimal  valued  parameters. 
Figure  3.1  provides  an  overview  of  the  program,  EXAG,  that  implements  the 
theory  of  exaggeration  in  three  phases.  The  TRANSFORM  PHASE  takes  a 
structural  description  of  the  system  and  a  perturbation  and  produces  a  new 
model  using  the  qualitative  hyperreal  representation  (section  3.1.2).  The 
SIMULATE  PHASE  (denoted  HR-QSIM  in  the  figure)  simulates  this  hyperreal 
model  to  produce  an  exaggerated  behavior  that  is  qualitatively  different  from 
the  behavior  QSIM  produces  using  the  original  model:  in  one  case  the  heat 
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has  dropped  a  finite  amount  while  in  the  other  it  has  dropped  only  a  neg¬ 
ligible  amount.  Finally,  the  SCALE  PHASE  compares  the  two  behaviors  and 
predicts  the  answer  to  the  original  comparative  analysis  question. 


V=d/dt  X 
V(0)=v0 


QSIM 


Transform 


i  _____  Higher 

Scale  Output 

'  Temp 


V=d/dt  X 
V(0)~  inf 


{HR-QSIM 


Figure  3.1:  Overview  of  the  Exaggeration  Algorithm 


Since  exaggeration  is  critically  dependent  on  the  notions  of  infinite  and  in¬ 
finitesimal  values,  the  next  section  defines  a  qualitative  representation  based 
on  the  hyperreal  numbers.  The  remainder  of  this  chapter  discusses  the  trans¬ 
form,  simulate,  and  scale  phases  in  turn.  Then,  in  chapter  4,  I  compare  the 
strengths  and  weaknesses  of  exaggeration  and  DQ  analysis. 


3.1  Qualitative  Representation  Extensions 


Various  AI  researchers  have  attempted  to  incorporate  into  their  programs  the 
seemingly  intuitive  notion  of  infinite  and  infinitesimal  numbers.  Frequently, 
the  result  has  been  inconsistent.  To  avoid  this  fate,  I  base  the  theory  of  ex¬ 
aggeration  on  the  sound  mathematical  formulations  of  nonstandard  analysis 
[33]. 
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3.1.1  The  Hyperreal  Numbers 


Although  the  technical  details  behind  nonstandard  analysis  are  tricky,  the 
intuition  is  simple.  This  section  sketches  an  outline  of  the  subject,  simplified 
from  Davis  and  Hersh’s  Scientific  American  article  [4].  For  a  discussion  of 
more  detailed  sources,  see  appendix  C. 

Many  mathematicians,  including  Newton  and  Leibniz,  have  used  the  «... 
cept  of  an  infinitesimal  when  reasoning  about  geometry,  but  only  as  an  in¬ 
formal  aid.  Everyone  recognized  that  the  very  idea  of  an  infinitesimal  is 
self-contradictory  since  it  violates  the  Archimedian  principle:  “Every  posi¬ 
tive  number,  no  matter  how  small,  grows  greater  than  one  when  added  to 
itself  enough  times.”  Thus  while  infinitesimals  might  be  a  useful  tool  on  the 
route  to  a  theorem,  any  final,  rigorous  proof  must  avoid  them,  perhaps  using 
the  concept  of  limit  instead. 

This  all  changed  in  the  early  1960s  when  Abraham  Robinson  proved  the 
xistence  of  infinitesimals  having  the  same  ‘properties’  as  ordinary  real  num¬ 
bers.  The  trick  was  defining  ‘properties’  correctly  so  that  the  Archimedian 
principle  did  not  count  as  a  property.  He  defined  property  to  mean  “express¬ 
ible  in  first  order  predicate  calculus.”  For  example,  one  can  use  this  language 
to  express  the  property  of  having  an  inverse  as  follows: 


Vz  (x  =  0)  V  (3 y  xy  =  1) 


Robinson’s  proof  starts  with  the  finite,  real  numbers;  call  them  the  STAN¬ 
DARD  REALS.  Let  K0  be  the  set  of  all  first  order  predicate  calculus  sentences 
which  are  true  about  the  standard  reals.  Of  course,  K0  is  such  a  big  set  that 
there  is  no  way  to  know  its  contents  (short  of  proving  every  possible  calculus 
theorem),  but  by  definition  the  standard  reals  are  a  model  of  A"0.  It  turns 
out,  however,  that  there  are  other  models  of  Kq  besides  the  standard  reals, 
and  one  of  these  models  contains  infinitesimals.  The  proof  is  simple  given  a 
result  called  the  compactness  theorem  [15]  which  states:  “A  set  of  sentences, 
K ,  has  a  model  if  every  finite  subset  of  A  has  a  model.” 

From  this  result,  the  existence  of  infinitesimals  follows  trivially!  Add  to 
K0  the  infinite  set  of  sentences: 


3/  |  0  <  /  <  - 
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And  so  on...  Every  finite  subset  of  these  sentences  will  be  true  of  the  real 
numbers,  since  a  finite  subset  will  contain  a  smallest  fraction,  and 
will  satisfy  those  sentences.  Thus  the  compactness  theorem  says  that  there  is 
a  model  that  contains  a  positive  number,  /,  which  is  less  than  -h  for  any  A/, 
in  other  words  an  infinitesimal!  This  model  is  often  called  NONSTANDARD 
simply  because  it  is  different  from  the  standard  reals;  however,  to  distinguish 
the  model  satisfying  this  set  of  sentences  from  other  nonstandard  models,  I 
use  the  name  HYPERREALS. 

Since  the  hyperreals  are  a  model  for  KQ,  they  act  much  like  the  standard 
real  numbers.  For  example,  they  are  closed  under  addition  and  multiplica¬ 
tion.  In  fact,  the  hyperreals  can  be  thought  of  as  a  superset  (technically, 
‘field  extension’)  of  the  standard  reals.  The  product  of  a  standard  real  and 
an  infinitesimal  is  an  infinitesimal.  The  product  of  two  infinitesimals  is  a 
new  infinitesimal.  Thus  it  turns  out  that  there  are  (uncountably )  many  in¬ 
finitesimals.  Since  Kq  includes  the  fact  that  nonzero  standard  real  numbers 
have  multiplicative  inverses,  nonzero  hyperreals  must  also.  The  inverse  of  an 
infinitesimal  is  called  an  infinite  number;  there  are  many  of  these  also.  The 
sum  of  a  standard  real  and  an  infinitesimal  is  not  a  standard  real,  it  is  a 
hvperreal  number  that  is  infinitesimally  close  to  the  standard  real.  Since  all 
infinitesimal  numbers  could  be  added  to  the  same  standard  real,  it  follows 
that  every  standard  real  number  has  a  HALO  of  hyperreal  numbers  surround¬ 
ing  it,  at  negligible  distance,  isolating  it  from  other  standard  reals.  The 
infinitesimals  are  simply  the  halo  of  zero. 

One  more  fact  proves  very  important.  Just  as  there  is  no  smallest  or 
largest  positive,  standard  real  number,  there  is  no  largest  infinitesimal  and 
no  smallest  infinity.  This  fact  occupies  considerable  attention  in  the  section 
on  the  simulate  phase. 

3.1.2  The  Qualitative  Hyperreals 

While  the  QSIM  qualitative  representation  is  an  elegant  abstraction  of  the 
standard  real  numbers,  it  does  not  suffice  for  the  hyperreals.  Parameters  still 
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map  from  time  to  their  respective  domains  (positions,  heats,  etc.),  but  they 
are  now  functions  to  and  from  the  hyperreal  numbers.  Kuipers’  restriction 
that  parameters  be  REASONABLE  FUNCTIONS,  is  still  valid;  the  intuition 
is  that  they  are  continuous,  continuously  differentiable,  and  have  at  most 
finitely  many  critical  points  in  any  bounded  interval  [27]. 

It  is  still  useful  to  decompose  the  state  of  a  parameter  into  two  parts: 
qualitative  value  and  qualitative  derivative,  but  each  of  these  parts  must  be 
extended.  In  the  QSIM  representation,  the  value  part  is  either  an  interesting 
LANDMARK  VALUE  such  as  0  or  q0  or  the  open  interval  between  two  landmark 
values,  e.g.,  the  interval  (0,  inf).  Since  landmark  values  are  a  major  way  of 
introducing  meaningful  qualitative  distinctions  into  a  domain  model,  they 
are  kept  in  the  qualitative  hyperreal  representation.  However,  inf  and  minf 
are  no  longer  considered  landmark  values;  they  are  treated  specially. 

Definition  14  Let  po  <  •  ■ .  <  Pk  be  the  landmark  values  of  a  parameter  P . 
For  any  time  t  define  the  qualitative  hyperreal  value  of  P  at  t  as: 

inf  if  P(t)  >  every  finite  number 

minf  if  P(t)  <  every  finite  number 

pj  if  P(t)  =  landmark  pj 

(HALO  pj  +  )  if  P(t)  —  Pj  is  infinitesimal  >  0 

(HALO  Pj  -)  if  P{t)  —  Pj  is  infinitesimal  <  0 

HR-QVAL(/,(t))  =  <  ^Pj,PJ+ 1>-  if  P(t)  -  Pj  and  pj+l  -  P(t)  are 

both  non-infinitesimal  and  >  0 
-<pk,  inf>-  if  P(t)  is  finite  and  P{t )  -  p*  is 
non-infinitesimal  >  0 

-<minfp0>-  if  P(t)  is  finite  and  P(t)  -  p0  is 
non-infinitesimal  <  0 

If  the  same  HR-QVAL  describes  a  parameter  for  all  instants  in  an  interval  of 
time,  A,  then  one  may  write  HR-QVAL(P(*4)). 

Thus  all  positive  infinities  are  collapsed  onto  the  symbol  inf  and  all  neg 
ative  infinite  numbers  are  denoted  minf.  Every  finite  landmark,  p,  has  an 
infinitesimal  halo  above  and  below  it;  these  halos  are  denoted  (HALO  p  +) 
and  (HALO  p  -)  respectively.  The  positive  infinitesimals,  for  example,  are 
represented  (HALO  0  +).  The  QSIM  expression  for  an  open  interval,  (pi,p2), 
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is  not  used  since  it  overlaps  with  (HALO  px  +)  and  (HALO  p2  —  )•  The  defi¬ 
nition  of  <Pi,P2>-  is  equivalent  to  the  difference  between  the  interval  ( Pi ,  ) 

and  the  two  halos. 

It  also  proves  useful  to  extend  the  representation  for  qualitative  deriva¬ 
tive.  In  the  QSIM  representation  the  derivative  part  of  a  qualitative  state 
is  a  simple  description  of  the  sign  of  the  parameter’s  derivative:  me,  dec,  or 
std.  The  qualitative  hyperreal  representation  distinguishes  between  increas¬ 
ing  parameters  depending  on  how  fast  they  are  growing. 

Definition  15  Let  P  be  a  parameter  and  t  be  a  time.  Define  the  qualitative 
hyperreal  direction  of  P  at  t  as  the  pair  of  its  qualitative  direction  and  its 
derivative ’s  order  of  magnitude: 

HR-QDIR (P(t))  =  (QDIR (P(t))  OM(|  P(t))) 

The  ^qualitative  direction,  QDIR,  is  either  inc,  dec,  or  std  as  formalized  in 
chapter  2’s  definition  J,.  Define  order  of  magnitude  as: 

inf  if  \x\  >  every  finite  number 
fin  if  \x\  =  a  positive  standard  real  number 
negl  if  \x\  =  negligible,  i.e.  a  positive  infinitesimal 
0  if  x  —  0 

If  the  same  HR-QDIR  describes  a  parameter  for  all  instants  in  an  interval  of 
time,  A,  then  one  may  write  HR-QDIR( P(A)). 

Thus  (dec  inf)  denotes  the  HR-QDIR  of  a  parameter  that  is  decreasing 
infinitely  fast.  If  a  parameter’s  HR-QDIR  is  (std  0),  then  it  may  be  abbreviated 
std  since  0  is  the  only  possible  order  of  magnitude  of  std. 

Definition  10  Define  the  hyperreal  qualitative  representation,  HR-QR,  of  a 
parameter  P  at  the  time  t  (or  the  interval  of  time,  A)  as  the  pair  of  its 
qualitative  hyperreal  value  and  direction: 

\P(t))}  =  (HR-QVAL(P(f)),  hr-qdir(  P(t))) 

The  HR-QR  of  a  parameter  is  denoted  by  square  brackets.  The  qualitative 
hyperreal  STATE  of  a  system  at  a  time  point  or  interval  is  the  set  of  HR-QRs 
for  all  the  parameters  in  the  system. 


3.1.3  Behaviors  over  Hyperreal  Time 

As  defined  in  chapter  2,  definition  7,  a  parameter  is  said  to  TRANSITION 
whenever  it  changes  to  a  new  qualitative  value.  However,  as  will  be  ex¬ 
plained  later,  these  hyperreal  transitions  are  less  intuitive  than  transitions 
between  standard  QSIM  qualitative  values.  For  example,  QSIM  transitions 
always  happen  at  a  well  defined  point  of  time  (called  a  ‘distinguished  time 
point’  in  chapter  2,  definition  6).  This  is  no  longer  true  in  the  qualitative  hy¬ 
perreal  representation.  When  a  parameter  changes  from  the  value  ( halo  0  -f ) 
to  -tO for  example,  there  is  no  single  time  point  when  the  transition 
happens.  This  is  discussed  more  in  section  3.3.2. 

Like  the  standard  QSIM  equivalent,  a  HYPERREAL  BEHAVIOR  is  defined 
as  a  sequence  of  qualitative  states.  However,  the  temporal  nature  of  these 
sequences  is  not  as  simple  as  it  is  in  the  QSIM  case  where  a  state  representing 
a  time  point  is  always  succeeded  by  a  state  over  an  open  time  interval.  As 
explained  more  fully  in  the  sections  on  predecessor-persistence  (3.3.4)  and 
successor-arrival  filtering  (3.3.5),  qualitative  hyperreal  states  can  persist  for 
a  closed  point  of  time  (written  0)  or  open  intervals  of  infinite  (inf),  finite 
(fin),  or  negligible  (negl)  duration. 

3.2  Transform  Phase 

The  transform  phase  converts  a  comparative  analysis  problem  into  a  simu¬ 
lation  problem  by  creating  a  model  of  the  system  which  has  an  exaggerated 
initial  value  for  some  parameter.  The  trick  is  to  produce  a  description  which 
has  a  qualitatively  different  behavior  than  the  original.  This  is  easy  for  the 
heat  exchanger  given  the  comparative  analysis  problem  “What  happens  to 
output  temperature  if  the  oil  moves  faster?”  The  transform  phase  produces 
a  description  with  infinite  oil  velocity.  In  general,  however,  three  questions 
must  be  answered  during  the  transform  process: 

•  Which  parameter  should  be  exaggerated? 

•  In  which  direction  should  the  parameter  be  transformed? 

•  What  should  be  the  final  value  of  the  parameter? 

The  following  sections  discuss  these  questions. 
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3.2.1  Choice  of  Parameter 

For  many  comparative  analysis  questions,  the  question  of  choice  of  parameter 
is  easy  to  answer.  Simply  transform  the  parameter  that  is  perturbed  in  the 
comparative  analysis  problem.  This  approach  appears  to  work  whenever  the 
perturbation  is  a  small,  differential  change. 

However,  there  are  slightly  different  comparative  analysis  problems  in 
which  it  is  unclear  which  parameter  should  be  transformed.  For  example, 
consider  the  two  heat  exchangers  shown  in  figure  3.2.  Hot  oil  is  cooled  by 
passing  it  through  a  narrow  pipe  which  is  in  contact  with  a  larger  pipe  holding 
cold  (but  warming)  water.  The  top  design  has  the  cold  water  flowing  in  the 
same  direction  as  the  hot  oil  while  the  bottom  design  has  the  two  streams 
running  counterflow.  An  interesting  comparative  analysis  question  is  “which 
design  can  cool  the  hot  oil  to  a  lower  temperature?” 


T  out 


Figure  3.2:  Regular  and  Counter  Flow  Heat  Exchangers 

Notice  that  this  question  is  not  of  the  differential  type.  The  difference 
between  the  two  designs  can  not  be  characterized  as  an  arbitrarily  small 
perturbation.  In  one  case  the  oil  velocity  is  positive,  in  the  other  it  is  negative; 

60 


the  landmark  value,  zero,  separates  the  two.  As  a  result,  transforming  the  oil 
velocity  does  not  result  in  an  answer.  If  one  considers  the  case  in  which  the  oil 
is  moving  very  slowly,  the  difference  between  the  two  designs  vanishes.  And 
if  one  considers  infinite  oil  velocity,  the  two  designs  again  act  the  same — only 
a  negligible  amount  of  heat  is  lost. 

However,  if  one  transforms  the  pipe  length  to  infinity,  then  a  difference 
between  the  designs  becomes  apparent.  In  both  cases,  the  oil  reaches  thermal 
equilibrium  before  exiting  the  pipe.  In  the  case  where  the  oil  and  coolant  flow 
in  the  same  direction,  the  equilibrium  temperature  is  intermediate  between 
the  oil  and  water  input  temperatures.  In  the  counterflow  heat  exchanger, 
however,  the  oil  leaves  in  equilibrium  with  the  fresh  cold  water  entering  the 
exchanger.  Thus  one  can  conclude  that  the  counterflow  exchanger  can  cool 
to  a  lower  temperature. 

But  how  does  one  know  to  exaggerate  the  pipe  length?  Transforming  to 
an  infinite  thermal  conductivity  would  have  worked  just  as  well,  but  no  other 
choice  results  in  an  answer.  Currently,  the  EXAG  program  only  solves  com¬ 
parative  analysis  problems  with  differential  perturbations;  this  counterflow 
heat  exchanger  problem  would  stump  it.  An  interesting  direction  for  future 
research  would  be  to  write  a  program  that  transformed  every  parameter  and 
analyzed  the  results.1  While  this  approach  would  likely  result  in  many  un¬ 
interesting  transformations,  insights  like  the  answer  to  the  counterflow  heat 
exchanger  comparison  problem  would  occasionally  result  as  well. 

3.2.2  Choice  of  Direction 

When  transforming  oil  velocity  to  answer  the  question  “What  happens  to  oil 
output  temperature  when  the  flow  rate  is  increased?”  EXAG  chooses  to  send 
the  velocity  to  its  limit,  infinity,  in  the  direction  of  the  perturbation.  This  is 
not  the  only  possibility,  however;  the  following,  equally  correct,  explanation 
would  result  if  one  transformed  in  the  other  direction. 

If  the  oil  moved  at  a  negligible  rate,  then  it  would  take  an 
infinite  time  to  exit  the  pipe.  Thus  the  oil  would  have  reached 
thermal  equilibrium  at  the  coolant’s  temperature  when  it  left. 

1  Olivier  Raimon  has  indicated  (personal  communication)  that  he  is  investigating  this 
possibility.  He  terms  the  various  results  ‘caricatures’  of  the  original  system. 


Since  this  is  colder  than  in  the  finite  velocity  case,  decreasing 
velocity  decreases  output  temperature  and  increasing  velocity  in¬ 
creases  output  temperature. 

There  are  two  criteria  for  selecting  the  best  direction  in  which  to  transform 
a  parameter:  ability  to  get  an  answer  and  the  intuitive  plausibility  of  the 
resulting  explanation. 

Asymmetric  Answers 

While  it  is  usually  the  case  that  exaggeration’s  ability  to  reach  an  answer 
is  insensitive  to  transform  direction,  this  is  not  always  the  case.  The  non 
differential  comparative  analysis  problem  of  the  counterflow  heat  exchanger 
(figure  3.2)  provides  an  immediate  example.  Transforming  pipe  length  to  in¬ 
finity  demonstrates  the  superiority  of  the  counterflow  design,  but  if  the  pipe 
length  is  negligible  then  there  is  no  difference  between  the  two  designs. 

Section  3.3.4  explains  an  asymmetry  in  the  simulation  algorithm  which 
partially  accounts  for  this  phenomena.  In  any  case,  a  simple  solution  is  to 
try  transforming  in  the  opposite  direction  if  the  first  yields  no  answer. 

Psychological  Appeal 

The  choice  of  transformation  direction  also  impacts  the  intuitive  appeal  of 
exaggerated  explanations.  For  example,  consider  a  horizontal,  frictionless 
block  oscillating  due  to  the  action  of  a  perfect  spring.  A  natural  comparative 
analysis  question  is  “What  happens  to  the  period  of  oscillation  if  the  mass 
of  the  block  is  changed?”  Most  people  find  it  more  convincing  to  imagine  a 
very  heavy  block  with  an  infinite  period  than  an  incredibly  light  block  with 
infinitesimal  period.  Since  this  effect  is  psychological,  it  is  very  difficult  to 
quantize.2  As  a  result,  EXAG  does  not  attempt  to  consider  this  factor  during 
the  transform  phase. 

JThis  psychological  effect  has  an  interesting  physical  basis.  If  the  block  has  negligible 
mass,  then  it  is  dominated  by  the  mass  of  the  spring.  The  modeling  decision  that  the 
spring  has  zero  mass  become  questionable  when  reasoning  about  small  blocks.  After  all, 
a  spring  with  no  block  attached  does  not  oscillate  infinitely  fast. 
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(X(0)]  =  (x0,{inc  inf)) 

[V(0)j  =  ( inf,std ) 

(<3(0)]  =  (q0,  (dec  fin)) 

[F(0)j  =  (/o,  (inc  fin)) 

[i*T(0)]  =  ( k0,std ) 

Figure  3.3:  Transform  Phase  Output 

3.2.3  Choice  of  Distance 

Once  one  has  chosen  a  parameter  and  the  direction  it  should  be  exaggerated, 
all  that  remains  to  choose  is  the  final  value.  For  most  problems,  the  correct 
choice  is  either  an  infinite  or  an  infinitesimal  value,  depending  on  the  trans¬ 
form  direction.  If  the  trend  is  towards  smaller  values,  EXAG  transforms  to 
infinitesimal  values,  not  to  zero.  This  is  the  best  way  to  avoid  troublesome 
discontinuities.  Sections  4.5  and  6.2.3  talk  more  about  this. 

When  the  trend  is  toward  larger  absolute  values,  EXAG  transforms  to 
inf  or  minf.  For  the  heat  exchanger  question  “What  happens  to  oil  output 
temperature  when  flow  rate  is  increased?”,  positive  infinity  is  a  good  choice. 
The  resulting  initial  state  is  easily  expressed  in  the  qualitative  hyperreal 
representation  (figure  3.3). 

Unfortunately,  it  is  not  always  appropriate  to  transform  a  positive  pertur¬ 
bation  to  infinity.  The  goal,  when  choosing  a  final  value,  should  be  to  create 
a  new  model  with  asymptotic  values  that  has  qualitatively  different  behavior 
when  simulated.  Infinitesimal  and  infinite  values  are  common  asymptotes, 
but  not  the  only  ones.  Consider  the  boiler  shown  in  figure  3.4;  cold  water 
flows  in  from  the  left  and  steam  exits  the  top. 

Given  the  comparative  analysis  question,  “What  happens  to  the  steam 
output  temperature  if  the  water  input  temperature  is  increased?”  Admit¬ 
tedly,  exaggeration  is  a  poor  technique  for  this  question;  3  however,  as  such 
it  is  instructive  to  see  how  exaggeration  must  tackle  the  problem.  Indeed, 
EXAG  does  the  wrong  thing  —  it  transforms  the  input  water  temperature 

3See  section  4  for  a  discussion  of  the  relative  merits  of  exaggeration  and  differential 
qualitative  analysis. 


Figure  3.4:  A  Boiler 

upwards  to  infinity.  The  upward  trend  is  correct,  but  infinity  is  a  bad  choice 
of  final  value.  The  resulting  behavior  depends  on  the  details  of  the  boiler 
model  (how  are  temperature,  pressure,  and  boiling  point  related?).  The  pos¬ 
sibility  exists  for  one  to  conclude  that  the  output  temperature  of  the  steam 
would  be  infinite.  Thus  one  might  think  that  an  increase  in  water  temper¬ 
ature  leads  to  an  increase  in  steam  temperature  when,  in  fact,  the  steam 
temperature  does  not  change. 

The  reason  that  this  is  a  poor  choice  is  simple.  While  an  infinite  water  in¬ 
put  temperature  does  cause  asymptotic  behavior,  it  is  not  the  first  asymptote 
reached  by  increasing  water  temperature.  When  the  temperature  approaches 
water’s  boiling  point,  the  boiling  rate  hits  infinity.4 

*This  all  depends  on  one’s  model  of  boiling.  For  now,  I  am  assuming  the  simple  model 
in  which  boiling  rate  is  proportional  to  the  flame’s  heat  flow  and  inversely  proportional  to 
the  difference  between  water  temperature  and  boiling  point.  A  model  which  incorporated 
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In  conclusion,  the  parameter  should  be  transformed  the  shortest  distance 
that  causes  some  parameter  to  reach  an  infinite  or  infinitesimal  value.  Fre¬ 
quently,  this  requires  explicitly  setting  the  transformed  parameter  to  a  hy- 
perreal  value,  but  not  always.  For  the  boiler  example,  input  temperature 
should  be  transformed  to  212  degrees  Fahrenheit 

3.3  Simulate  Phase 

Since  the  beauty  of  exaggeration  is  that  it  reduces  a  comparative  analysis 
problem  to  a  problem  of  qualitative  simulation,  it  should  be  no  surprise  that 
the  simulate  phase  is  the  most  difficult  of  the  three.  The  trick  is  to  demon¬ 
strate  a  qualitative  simulation  technique  that  can  handle  parameters  with 
infinite  and  infinitesimal  values.  Because  Kuipers’  QSIM  [27,28]  is  simple, 
precisely  defined  and  widely  available,  I  chose  it  as  basis  for  the  simulate 
phase.  Sections  5.2  and  4.5  discuss  problems  with  this  choice  and  alternate 
choices. 

Unfortunately,  the  addition  of  infinite  and  infinitesimal  values  requires  a 
surprising  number  of  modifications.  The  fundamental  problem  is  due  to  the 
strong  reliance  that  all  qualitative  simulation  algorithms  place  on  the  order 
topology  of  the  standard  real  numbers  [50] ;  QSIM,  for  example,  assumes  that 
the  value  spaces  of  time  and  the  various  parameters  alternate  between  open 
intervals  and  closed  points.  Unfortunately,  the  presence  of  infinitesimals  in 
the  hyperreals  results  in  a  more  complex  topology  where  this  is  no  longer  the 
case. 

The  next  section  briefly  reviews  QSIM.  Then  I  present  the  extensions 
which  together  form  the  HR-QSIM  algorithm:  new  transition  tables,  en¬ 
hanced  constraint  filters,  the  predecessor-persistence  filter,  the  successor- 
arrival  filter,  and  the  irrelevant-transition  filter. 

3.3.1  How  QSIM  Works 

The  following  description  is  simplified  from  [27].  QSIM  takes  as  input  a  set  of 
parameters  (e.g.,  X,  V,  F,  Q,  K),  a  set  of  constraints  relating  the  parameters 
(e.g.,  figure  2.4),  and  a  set  of  initial  qualitative  states  for  the  parameters.  As 

the  latent  heat  of  vaporization  would  be  more  complicated. 


output,  QSIM  produces  a  tree  of  states;  each  path  through  the  tree  represents 
a  possible  behavior  (e.g.,  figure  2.6  represents  one  path)  of  the  system.  The 
first  step  of  QSIM  is  to  push  onto  a  queue  an  initial  state  constructed  from 
the  initial  conditions.  Then  the  following  steps  are  executed  repeatedly  until 
the  queue  is  empty  or  (or  until  some  arbitrary  number  of  states  have  been 
generated). 
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1.  Select  a  state  from  the  queue. 


For  each  parameter  in  the  system,  use  the  parameter’s  qualitative  state 
(value  /  derivative  pair)  as  an  index  into  a  TRANSITION  TABLE.  By 
exploiting  the  assumption  that  all  parameters  are  continuously  differ¬ 
entiable,  transition  tables  contain  only  a  few  next  value  /  derivative 
pairs  for  each  index.  For  example,  if  the  representation  of  a  parameter 
at  a  time  point  is  ‘at  the  point  l{  and  inc\  then  in  the  time  internal  af¬ 
ter  the  point,  the  only  possible  qualitative  value  is  the  interval  (/,,  /t+1) 
and  the  derivative  must  still  be  inc. 


3.  For  each  constraint  relating  the  parameters,  generate  the  set  of  value 
/  derivative  tuples  (pairs  or  triples)  by  computing  the  cross  product 
of  the  possibilities  from  step  2.  Filter  out  the  tuples  whose  values  or 
derivatives  don’t  satisfy  the  constraint. 


4.  For  each  pair  of  constraints  that  share  a  parameter,  P,  check  for  con¬ 
sistency.  If  one  constraint  has  a  tuple  which  assigns  P  a  qualitative 
value  /  derivative  that  is  consistent  with  none  of  the  other  constraint’s 
tuples,  then  prune  that  tuple. 


5.  Generate  all  possible  global  interpretations  from  the  remaining  tuples. 
If  interpretations  exist,  then  create  new  states  and  make  them  succes¬ 
sors  of  the  existing  state. 


6.  Apply  global  filtering  rules.  For  example,  prune  new  states  that  are 
qualitatively  indistinguishable  from  the  previous  state.  Add  the  re¬ 
maining  states  to  the  queue. 


The  next  sections  explain  the  substantial  modifications  necessary  to  em¬ 
brace  the  qualitative  representation  of  the  hyperreals.  Section  3.3.2  explains 
how  step  2  requires  four  instead  of  two  transition  tables;  in  addition  the 
choice  of  table  is  more  complex.  Section  3.3.3  discusses  the  new  constraint 
filters  that  are  necessary  for  step  3,  and  shows  how  one  existing  filter  needs 
to  be  modified.  The  most  important  change  is  the  addition  of  temporal 
filtering,  unnecessary  in  the  original  QSIM  representation.  Two  kinds  of 
temporal  filters  are  required:  section  3.3.4  predecessor-persistence  filtering 
and  section  3.3.5  presents  successor- arrival  filtering.  Section  3.3.6  introduces 
several  improvements  to  these  techniques. 
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3.3.2  Transition  Tables 


The  extended  qualitative  representation  requires  extensive  changes  in  the 
use  of  transition  tables.  QSIM  uses  two  tables  while  HR-QSIM  needs  four. 
With  QSIM  it  is  always  obvious  which  table  to  use,  but  this  is  no  longer  the 
case  with  HR-QSIM.  The  difference  results  from  the  fact  that  the  hyperreals 
have  a  different  topology  than  the  standard  real  numbers.  However,  before 
considering  this  difference  in  detail,  it  is  necessary  to  understand  why  QSIM 
has  two  tables  in  the  first  place. 

QSIM  Uses  Two  Different  Tables 

QSIM  uses  two  transition  tables  to  avoid  generating  inconsistent  combina¬ 
tions  of  transitions  that  would  need  to  be  filtered  later.  Because  parameters 
are  continuous,  certain  transitions  (i.e.  changes  in  qualitative  representa¬ 
tion)  can’t  happen  at  the  same  time.  QSIM  uses  two  tables  to  group  all  the 
compatible  state  changes  together  so  that  these  inconsistent  transitions  are 
never  considered. 

For  example,  consider  a  system  with  two  parameters,  A  and  B.  Let  S0 
denote  the  qualitative  state  in  which  A  ~  (a0,  std)  and  B  =  ((60, ),  inc).  Let 
Si  denote  the  qualitative  state  in  which  A  =  ((a0,  a1)inc)  and  B  ~  ( bt,std ). 
Although  the  change  in  A’s  value  from  S0  to  S i  is  possible  and  the  same  is 
true  for  B,  it  is  not  possible  for  So  to  directly  precede  S i-  In  other  words  the 
two  transitions  cannot  happen  at  the  same  time. 

Seeing  why  this  is  true  requires  a  rudimentary  understanding  of  the  OR¬ 
DER  TOPOLOGY,  the  study  of  open  and  closed  sets  as  defined  by  the  ‘less 
than’  inequality  [30]. 

Definition  17  A  set  O  of  real  numbers  is  OPEN  if  forall  x  in  O  there  exists 
numbers,  a  and  b  such  that  a  <  x  <  b  and  all  other  numbers  y  which  satisfy 
a  <  y  <  b  are  members  of  O.  A  set  C  is  CLOSED  if  its  complement  is  open.5 

While  it  is  possible  for  a  set  to  be  neither  open  nor  closed,  only  two 
sets  of  standard  reals  are  both  open  and  closed:  the  empty  set  and  the  set 

5TechnicaUy,  I  should  be  saying  “a  subset  is  open  with  regard  to  the  whole  space". 
However,  since  I  will  always  be  considering  openness  with  regard  to  a  whole  space  and 
that  space  is  obvious  from  context,  I  leave  that  phrase  understood. 


of  all  standard  reals.  QSIM  is  concerned  with  two  simple  kinds  of  sets: 
sets  containing  a  single  point,  which  are  always  closed,  and  noninclusive 
intervals  between  two  points,  (a, 6),  which  are  always  open.  In  fact,  every 
QSIM  behavior  (such  as  that  of  figure  2.6)  is  a  sequence  of  states  alternating 
between  the  state  of  the  system  at  a  closed  time  point  and  the  state  at  an 
open  time  interval.  All  this  wouldn’t  matter  except  that  parameters  are 
continuous  functions  of  time.  This  becomes  clear  when  one  considers  the 
general  definition  of  continuity  [30]  (more  general  than  the  familiar  epsilon- 
delta  version  because  it  does  not  depend  on  standard  real  values). 

Definition  18  A  function  F  :  X  — »  y  is  CONTINUOUS  if  and  only  if  for 
every  open  subset,  li,  of  y,  the  preimage  of  14,  F~l(U),  is  open. 

This  explains  why  A  and  B  in  the  example  above  can’t  transition  at  the 
same  time.  The  qualitative  value,  <z0,  represents  a  closed  set  of  real  numbers, 
but  (6o>&i)  denotes  an  open  set.  Since  the  parameter  B  is  a  continuous 
function  of  time,  the  set  of  times,  lb,  when  B  has  qualitative  value,  (60)M) 
must  be  open.  Similarly,  A  has  value  a0  for  a  closed  set  of  times,  Za.  If  state 
S0  directly  precedes  Si,  then  Ia  must  equal  Ib.  But  this  implies  that  Ia  is 
both  open  and  closed.  Yet  we  know  that  Ia  is  neither  the  empty  set  (since 
state  S0  exists)  nor  all  of  time  (since  state  Si  exists).  Thus  Ia  does  not  equal 
I;,,  i.e.  the  parameters  must  transition  at  different  times.  This  example  can 
be  generalized  as  follows  (also  see  figure  3.5). 

Definition  19  When  a  parameter  transitions  from  a  qualitative  representa¬ 
tion  representing  an  open  set  to  one  denoting  a  closed  set  of  standard  real 
numbers,  the  change  is  called  an  OC-TRANSITION.  When  the  transition  is 
from  a  closed  set  to  an  open  set,  the  event  is  called  a  CO-TRANSITION.6 

Proposition  13  Given  two  adjacent  states  S,  and  S,+i  in  a  standard  QSIM 
behavior,  if  parameters  A  and  B  each  take  on  different  qualitative  represen¬ 
tations  in  the  two  states,  then  they  both  CO-transition  or  both  OC-transition. 

9Kuipers  uses  the  term  “I-transitions”  instead  of  OC-transitions  since  they  are  transi¬ 
tions  from  an  open  interval  to  a  closed  point.  Similarly,  he  uses  the  term  “P-transitions” 
instead  of  CO-transitions.  Unfortunately,  his  terminology  does  not  extend  well  to  the 
hyperreals. 


Figure  3.5:  Transitions  among  Standard  (QSIM)  Qualitative  Values 


By  separating  CO-transitions  and  OC-transitions  into  two  tables,  QSIM 
reduces  the  number  of  candidates  that  get  filtered  in  algorithm  stages  three 
and  four.  It  is  easy  to  choose  the  right  table  to  use.  If  the  current  state 
is  at  a  closed  time  point,  then  the  table  of  CO-transitions  is  correct.  If  the 
current  state  is  over  an  open  time  interval,  QSIM  selects  the  table  of  OC- 
transitions.  As  figure  3.6  shows7  for  the  single  index,  ( U,std ),  the  possible 
transition  given  by  the  two  tables  are  different,  but  not  disjoint.  For  example, 
both  tables  include  entries  that  specify  no  change.  As  explained  in  [49,27]  the 
Mean  Value  Theorem  and  Intermediate  Value  Theorem  of  calculus  provide 
the  constraint  that  limits  the  number  of  entries  in  each  table. 


CO-transitions 

OC-transitions 

( li,std ) 

{(li-i,h),dec) 

(li,std) 

Figure  3.6:  QSIM  Transition  for  (li,std) 


HR-QSIM  Needs  Four  Tables 

Because  the  topology  of  the  hyperreals  is  more  complex  than  that  of  the 
standard  reals,  there  are  four  incompatible  types  of  transitions  and  thus 

7This  data  is  based  on  Table  1  of  (27,  page  300]. 


four  transition  tables.  Two  of  the  tables  have  the  same  topology  as  QSIM’s 
tables.  When  a  parameter  changes  from  a  landmark  value  to  the  point’s 
halo,  it  undergoes  a  CO-transition.  The  reverse  change  is  an  OC-transition. 
But  when  a  parameter  moves  between  a  halo  and  a  standard  real  interval  or 
between  a  standard  real  interval  and  infinity,  the  situation  gets  more  complex. 

Consider  a  state  change  from  (HALO  0  +)  to  -<0,  inf-.  Since  there  is 
no  largest  infinitesimal  [33],  (HALO  0  +)  is  an  open  set.  Because  there  is  no 
smallest  positive  standard  real  number,  -<0,  inf?-  is  also  an  open  set.8  Thus 
this  transition  has  a  peculiar  open-open  topology  that  would  be  impossible 
in  the  standard  reals  and  thus  is  not  considered  by  QSIM. 

The  same  reasoning  that  lead  to  proposition  13  dictates  that  one  of  these 
open-open  transitions  cannot  happen  at  the  same  time  as  a  CO-transition 
or  an  OC-transition.  However,  it  turns  out  that  there  are  two  incompatible 
groups  of  transitions  that  share  the  open-open  topology. 

Definition  20  When  a  parameter  transitions  from  one  qualitative  represen¬ 
tation  to  another  HR-QR  such  that  i*s  qualitative  value  changes  from  a  non¬ 
standard  open  value  to  a  standard  open  value  or  its  qualitative  derivative 
changes  from  a  negl  rate  to  a  fin  rate,  the  event  is  called  an  NS-TRANSITION . 

A  change  in  HR-QR  is  called  a  SN-TRANSITION  if  the  opposite  change  is  a 
NS -transition. 

For  example,  when  a  parameter  changes  from  a  qualitative  value  of  ( HALO  l, 
-f )  to  the  change  is  an  NS-transition.  If  the  parameter  moved  from 

^0,  inf-  to  m/then  the  change  would  be  termed  a  SN-transition. 

Proposition  14  A  NS-transition  cannot  happen  at  the  same  time  as  a  SN- 
transition. 

Proof:  There  are  several  cases  to  consider.  The  proof  of  the  first  case  is 
taken  from  Ernie  Davis  justification  for  his  temporal  topology  rule  [3]. 

1.  An  NS-transition  from  (HALO  0  +)  to  -<0,  inf-  cannot  happen  at 
the  same  time  as  an  SN-transition  from  -<0,  inf-  to  inf.  Consider 
a  system  with  three  parameters,  A ,  B  and  C  obeying  the  constraint 

8In  fact,  both  these  sets  are  both  open  and  closed — a  very  different  state  of  affairs  from 
the  topology  of  the  standard  reals. 


C  =  MULT(A,  B).  Let  So  denote  a  qualitative  state  in  which  A  has 
qualitative  value  (HALO  0  +),  and  B  has  value  -<0,  inf- .  Let  S\  de¬ 
note  a  qualitative  state  in  which  A  has  qualitative  value  -<0,  inf- -  and 
B  has  value  inf  Although  the  change  in  A’s  value  from  So  to  St  is 
possible  and  the  same  is  true  for  B,  it  is  not  possible  for  <S0  directly 
precede  Si .  Since  C  —  MULT(A,  B),  C  has  qualitative  value  (HALO  0 
+  )  in  state  S0  and  inf  in  Si.  Because  the  continuous  parameter  C' 
cannot  jump  between  these  two  values  without  hitting  the  intervening 
values,  the  two  states  cannot  be  adjacent. 


2.  A  NS-transition  from  (HALO  0  +)  to  -<0,  inf-  cannot  happen  at  the 
same  time  as  a  SN-transition  from  ~<0,  inf-  to  (HALO  0  +).  The  pre¬ 
vious  proof  carries  if  one  uses  the  constraint  A  =  MULT (B,C). 


3.  A  NS-transition  from  (HALO  lt  +)  to  inf -  cannot  happen  at  the 

same  time  as  a  SN-transition  from  -t0,  inf -  to  inf.  This  is  shown  by 
constructing  a  system  which  violates  case  1  through  the  use  of  an  ADD 
constraint.  As  one  parameter  transitions  from  (HALO  /,  r )  to  inf-, 
the  new  parameter  transitions  from  (HALO  0  -t  )  to  -(0,  inf-. 


From  these  base  cases,  all  other  situations  can  be  derived  □ 


Finite  1 
IntervalJ 


Infinite 


Figure  3.7:  Transitions  among  Qualitative  Hvperreal  Values 


Thus  HR-QSIM  needs  to  use  four  different  tables  (figure  3.7)  to  predict 
possible  transitions,  one  table  for  each  of:  OO-transitions,  OO-transitions, 
NS-transitions  and  SN-transitions.  Like  the  original  tables  of  Williams  or 
Kuipers,  the  HR-QSIM  tables  exploit  topology,  the  Mean  Value  Theorem  and 
the  Intermediate  Value  Theorem.  Figure  3.8  shows  the  table  entries  which 


4  ,  »  m  , 


are  analogous  to  .ie  QSIM  entries  of  figure  3.6.  The  NS  and  SN  entries  are 
not  very  interesting  because  the  initial  value  is  a  closed  point  which  renders 
impossible  any  open-open  transition  topology.  Figure  3.9  shows  the  possible 
next  HR-QRs  for  the  index  ((HALO  0  +),  ( inc  negl))  assuming  a  quantity  space 
of  ( minf  0  inf).  Entries  for  other  index  HR-QRs  are  similar;  space  constraints 
preclude  showing  them  all.  In  fact,  for  space  reasons,  they  are  implemented 
procedurally  (see  appendix  D  for  the  code  listing). 


CO-transitions 

OC-transitions 

(/,  ,  std) 

( U ,  std) 

((HALO  /,  -\-),(inc  neg)) 

((HALO  li  —),(dec  neg)) 

NS-transitions 

SN-transitions 

(h,f)td) 

( li ,  std) 

Figure  3.8:  Hyperreal  Transitions  from  (l^std) 


CO-transitions 

OC-transitions 

((HALO  0  +),(mc  negl)) 

((HALO  0  +  ),  (inc  negl)) 

NS-transitions 

SN-transitions 

((HALO  0  +),(inc  negl)) 
((HALO  0  +  ), ( inc  fin)) 
(-<0,  inj>-,(inc  fin)) 

( -<0,  inf>~,(  inc  negl) ) 

((HALO  0  +),( inc  negl)) 

Figure  3.9:  Hyperreal  Transitions  from  ((HALO  0  -f),(mc  negl)) 


Since  QSIM  behaviors  consist  of  sequences  of  states  alternating  bet  ween 
closed  time  points  and  open  intervals,  the  temporal  topology  uniquely  deter 
mines  which  transition  table  should  be  used.  If  the  current  state  is  at  a  closed 


point,  only  CO-transitions  need  be  considered.  The  situation  is  more  com 
plex,  however,  when  performing  qualitative  simulation  using  the  hyperreals. 
States  can  persist  for  a  closed  time  point,  or  an  open  interval  of  negligible, 
finite  or  infinite  duration.  When  a  state’s  temporal  topology  is  open,  then 
three  tables  must  be  tried:  OC,  NS  and  SN-transitions.  As  a  result,  a  single 
state  can  have  two  (or  more)  alternate  successor  states  resulting  from  differ¬ 
ent  types  of  transitions.  If  more  than  one  table  predicts  the  same  transition 
(e  g.,  no  change)  then  the  duplicates  are  pruned. 

Possible  Transitions  for  the  Heat  Exchanger 

This  section  applies  the  transition  tables  to  the  problem  of  the  heat  exchanger 
example.  As  explained  in  section  3.2.3  (and  figure  3.3),  the  transform  phase 
generates  an  initial  state  that  corresponds  to  a  heat  exchanger  with  an  infinite 
rate  of  fluid  flow. 

[*(0)1  =  (x0,(inc  inf)) 

[V(0)j  =  ( infistd ) 

[Q(0)j  =  (q0,  (dec  fin)) 

[F(0)j  =  (/o,  ( inc  fin)) 

[*(0)1  =  (ko,std) 

The  principle  of  continuity  as  embodied  in  the  HR-QSIM  transition  t  ables 
greatly  limits  the  set  of  possible  transitions  for  this  state.  The  independent 
parameters,  V  and  K ,  can  never  change  by  definit  ion  (and  thus  aren’t  shown), 
and  the  other  parameters  each  have  only  one  possible  next  HR-QR  (from  the 
CO-transition  table): 

[X(-4i)l  =  ((HALO  t0  +),(inc  inf)) 

[<?M«)j  =  ((halo  q0  -),(derfin)) 

[*Mi)l  -  ((halo  fo  +),(inc  fin)) 

Since  these  HR-QRs  are  determined  to  be  consistent  (as  described  in  the 
next  two  sections)  they  define  the  sole  successor  to  the  initial  state.  This 
successor  state  lasts  for  some  (as  yet  undetermined)  interval  of  time  A\- 
Next,  the  transition  tables  are  consulted  again;  this  time  the  NS-  and  S\ 
transition  tables  produce  several  possibilities.  The  NS  transition  table  allows 
the  following  possible  HR-QRs: 


[X(w42)j  =  ((HALO  x0  +),(inc  inf))  or 

(<x0,Q>-,{inc  inf))  or 

(^xo?0^,(mc  fin))  or 

((HALO  x0  +  ),(inc  fin)) 

[Q(A)1  =  ((halo  q0  -),(dec  fin))  or 

(<0,qo>-,(dec  fin)) 

[F(42)]  =  ((HALO  f0  +),(inc  fin))  or 

(-<fo,0>-,(incfin)) 

Since  X  has  four  possible  HR-QRs,  Q  has  two,  and  F  has  two,  there  are 
4  *  2  *  2  =  16  possible  (not  necessarily  consistent)  HR-QR  tuples  that  might 
form  successor  states  over  the  time  interval  A2.  In  addition,  the  SN-transition 
table  admits  the  following  possible  HR-QRs: 


[X(A2)\  =  ((halo  x0  +),(inc  inf)) 

[Q(^42)j  =  ((HALO  <?0  — ),  (dec  negl))  or 

((HALO  q0  -),{dec  fin))  or 

((HALO  q0  -),(dec  inf)) 

[F(.42)]  =  ((HALO  f0  +),(inc  negl))  or 

((HALO  f0  +),(inc  fin))  or 

((HALO  f0  +),(inc  inf)) 


This  results  inl*3*3  =  9  more  HR-QR  tuples  some  of  which  might 
form  consistent  successor  states.  Since  both  tables  predicted  the  possibility 
that  all  parameters  might  remain  unchanged,  the  total  number  of  potential, 
different  successor  states  is  15  +  8  =  23.  These  states  are  not  represented 
explicitly,  however,  until  Waltz  filtering  has  been  performed  using  knowledge 
of  the  heat  exchanger’s  structural  constraints. 

3.3.3  Constraint  Filters 

Most  of  the  QSIM  filters  work  for  the  qualitative  hyperreal  representation 
without  significant  changes.  The  derivative  constraint,  V  =  jt(X),  for  ex¬ 
ample  is  violated  by  the  NS-transition  predictions  that  X  might  take  on  the 
HR-QDIR  of  (inc  fin)  since  V  =  ( infstd ).  Checking  this  constraint  reduces 
the  total  space  of  possible  states  from  23  to  9. 

The  type  of  filtering  that  requires  augmentation  is  that  pertaining  to 
corresponding  values.  Given  a  constraint,  say  F  =  MULT(A,(?),  and  a  set  of 


values  that  are  known  to  fit  the  constraint,  say  the  initial  values  fo,k0,  and 
q0,  then  tuples  of  values  can  sometimes  be  filtered  when  otherwise  they  would 
appear  to  match  the  constraint.  For  example,  suppose  that  QSIM  generated 
the  following  values:  /0  for  F,  k0  for  K,  and  (0,<?o)  for  Q.  Without  checking 
corresponding  values,  this  tuple  would  seem  to  satisfy  the  constraint  since  the 
signs,  -  -  +,  are  acceptable.  By  checking  previously  noted  values,  however, 
QSIM  realizes  that  this  tuple  is  impossible.  It  does  this  by  computing  the 
sign  of  the  difference  between  the  proposed  values  and  the  known  values. 
This  case  is  inconsistent  [27],  but  if  F  had  the  interval  value,  (/o,0),  then 
the  differences  would  have  been  acceptable. 

In  adapting  this  algorithm  to  the  hyperreal  representation,  some  changes 
are  necessary.  In  addition  to  checking  the  sign  of  the  difference  between 
proposed  and  known  corresponding  values,  HR-QSIM  also  checks  the  order 
of  magnitude  of  the  distance  as  well.  Thus  the  F-K-Q-tuple,  (HALO  f0  +  ),  k0, 
-<0,  ,  is  eliminated  even  though  the  signs  of  the  differences  are  satisfactory. 

It  is  important  to  realize  that  inf  and  minf  are  not  like  normal  landmark 
values;  they  each  represent  a  whole  interval  of  hyperreal  numbers.  As  a  result, 
corresponding  values  that  include  an  infinity  are  never  unique,  hence  less 
useful  for  filtering.  Filtering  HR-QR  tuples  with  inconsistent  corresponding 
values  reduces  the  number  of  possible  states  from  9  to  5. 

In  addition  to  these  checks  on  the  order  of  magnitude  of  parameters  that 
are  related  by  a  constraint,  it  is  useful  to  check  the  order  of  magnitude  of  the 
qualitative  derivatives  of  parameters  involved  in  a  constraint.  Again  consider 
the  constraint  F  =  MULT(A',  Q)  and  suppose  that  the  qualitative  derivative 
of  F  is  ( inc,negl )  and  that  of  K  is  std,  then  the  qualitative  derivative  of 
Q  must  be  (dec,  negl).  However,  if  the  heat  exchanger  had  infinite  thermal 
conductivity,  i.e.  K  were  min/then  the  situation  would  be  more  complicated. 
HR-QSIM  uses  a  qualitative  version  of  the  rule: 

£(FG)  =  F£g  +  G£F 

This  rule  reduces  the  number  of  possible  new  successor  states  from  5  to  3. 9 

Either  X  transitions  to  -<io,0>-  while  Q  and  F  remain  in  their  halos: 

9The  relative  power  of  these  filtering  rules  is  skewed  by  the  order  of  application. 
Whichever  filter  is  applied  first  usually  culls  out  the  greatest  number  of  inconsistent  pos¬ 
sibilities.  A  more  accurate  metric  is  the  increased  number  of  possible  successors  when  a 
given  filter  is  turned  off. 


[X(^42)j  =  Hzo,0  y,{incinf)) 

[Q{A2)\  =  ((HALO  q0  -),(dec  jin)) 

[F(A)1  =  ((HALO  f0 +),(inc  fin)) 

Or  Q  and  F  transition  out  of  their  halos  while  X  remains  in  its: 

[X(.42)]  =  ((HALO  x0  +  ),(mc  inf)) 

[Q{A. 2)]  =  (^0,qo>-,(dec  fin)) 

[F(-42)j  =  (<fo,0y,(inc  fin)) 

Or  all  three  parameters  transition  out  of  their  halos: 

pf(.42)]  =  ((HALO  x0  +),(inc  inf)) 

[Q(A 2)j  =  ((HALO  q0  -),(dec  fin)) 

\F(A2) j  =  ((HALO  f0  +),{inc  fin)) 

The  next  sections  explains  how  HR-QSIM  uses  the  predecessor-persistence 
and  successor- arrival  filters  to  determine  that  only  the  first  of  these  possibil¬ 
ities  is  reasonable. 


3.3.4  Predecessor- Persistence  Filter 

The  final  extensions  have  to  do  with  time.  QSIM’s  temporal  representation  is 
simple:  states  persist  for  either  an  instant  (a  closed  point  of  time)  or  a  finite 
open  interval.  Furthermore,  QSIM  can  quickly  tell  how  long  any  state  will 
last;  if  the  predecessor  state  lasted  for  an  instant,  the  successor  will  persist 
for  an  interval  an^  vice  versa.  The  situation  is  not  so  simple  for  HR-QSIM. 
Since  the  qualitative  hyperreal  representation  allows  derivatives  to  have  a 
negligible  order  of  magnitude,  a  state  might  last  for  an  infinite  time  before 
a  parameter  transitioned  to  a  new  landmark  value.  And  if  some  parameter 
had  an  m/derivative,  then  the  state  might  persist  for  only  a  negligible  time. 
Since  the  original  QSIM  cases  are  also  still  possible,  I  distinguish  between 
the  following  four  qualitative  lengths  of  time:  0,  negl,  fin ,  and  inf.  HR-QSIM 
uses  two  techniques,  predecessor-persistence  filtering  and  successor-arrival 
filtering  (section  3.3.5),  to  deduce  the  temporal  extent  of  qualitative  states 
and  to  prune  inconsistent  successors  during  simulation. 

The  difference  between  the  two  techniques  results  from  the  following  in¬ 
teresting  observation  about  transitions  in  the  qualitative  hyperreal  represen¬ 
tation: 


It  may  take  longer  for  a  parameter  to  transition  to  a  new 
qualitative  value  than  it  spends  in  its  old  value. 

Lest  this  sound  confusing,  consider  the  following  concrete  example. 

Let  P  be  a  parameter,  in  other  words  a  function  from  the  hyperreals  to 
the  hyperreals,  defined  as  the  identity  function  P(t )  =  t  (see  figure  3.10). 
Consider  the  set  of  times  that  the  qualitative  value,  ( halo  0  +  )  accurately 
describes  P  (below  I  formalize  this  notion  as  the  “persistence  of  a  parameter’s 
value”).  I  claim  that  P  persists  in  ( halo  0  +)  for  a  negligible  length  of  time. 
One  can  derive  a  contradiction  otherwise.  For  example,  if  P  persists  in 
the  halo  for  a  standard  finite  time,  t0,  then  that  would  imply  that  t0  £ 
(HALO  0+)  in  other  words  that  to  is  an  infinitesimal.  This  contradicts  the 
assumption  that  t0  was  a  standard  finite  number.  Persistence  values  of  inf  and 
0  also  result  in  contradictions.  Thus  P  maintains  the  value  of  (HALO  0  +  ) 
for  negl  time. 


P(t)  =  t 


Figure  3.10:  The  Difference  Between  Peristence  and  Arrival  Times 

Now  consider  the  time  it  takes  for  P  to  reach  the  qualitative  value,  -<0, 
infy.  The  next  section  formalizes  this  notion  as  ‘successor-arrival  time’;  here 
I  argue  that  P’s  successor-arrival  time  is  fin.  By  definition  of  -<0, 
when  p  reaches  this  qualitative  value  it  must  have  taken  a  standard  real 
value,  r0.  Thus  r0  time  must  have  elapsed  since  P  left  0.  Since  only  negl 


time  passed  reaching  (HALO  0  -f )  from  O,10  P  must  take  fin-negl=fin  time 
to  arrive  at  its  new  qualitative  value.  But  this  means  that  P  takes  longer 
to  reach  its  new  value  than  it  spends  in  its  original  value.11  Remember  that 
this  is  true  even  though  there  is  no  intervening  hyperreal  value  sandwiched 
between  (HALO  0  +)  and  -*<0,  inf>~. 

Several  benefits  result  from  considering  persistence  and  arrival  temporal 
measures  separately.  The  relationship  between  the  time  when  one  state  ends 
and  another  starts  is  made  clear.  The  resulting  theory  of  hyperreal  simu¬ 
lation  is  clean,  even  if  unintuitive.  Finally,  an  effective  algorithm  results. 
The  remainder  of  this  section  concerns  predecessor-persistence  filtering,  a 
technique  for  eliminating  impossible  successor  states  by  checking  persistence 
times.  Section  3.3.5  deals  with  the  related  technique,  the  successor-arrival 
filter.  Both  techniques  use  a  common  mechanism,  the  DISTANCE-RATE-TIME 
TABLE  to  compute  temporal  values.  This  table  is  indexed  by  rate  and  dis¬ 
tance  values  and  returns  a  time  value.  In  both  cases,  the  rate  expressions 
come  directly  from  the  order  of  magnitude  of  the  parameter’s  qualitative 
derivative.  The  difference  between  the  time  a  parameter  will  persist  in  its 
current  value  and  the  time  required  to  reach  its  successor  value  comes  from 
the  distance  used  to  index  into  the  table.  To  calculate  the  time  a  parameter 
can  persist  in  a  qualitative  value,  the  ‘width’  of  the  qualitative  value  is  used 
as  a  table  index. 

Width  of  a  Qualitative  Value 

Intuitively,  the  width  of  a  qualitative  value  is  the  order  of  magnitude  of  the 
maximum  distance  between  any  two  members  of  the  set  of  hyperreal  points 
that  underlie  the  qualitative  value. 

Definition  21  Let  P  be  a  parameter  and  T  be  a  qualitative  hyperreal  value 
of  P.  Define  the  set  of  hyperreal  points  ofT  as 

POINTS(r)  =  {p\P(t)  =  p  =>  HR-QVAL(P(t))  =  T} 

l0This  is  justified  below,  but  it  makes  intuitive  sense  since  zero’s  halo  is  only  a  negl 
distance  from  zero. 

11  Mathematically  oriented  readers  who  are  interested  in  the  cause  of  this  phenomena 
are  directed  to  the  fact  that  the  hyperreal  numbers  do  not  have  the  least  upper  bound 
property. 


Define  the  WIDTH  of  a  qualitative  value,  T,  as  the  maximum  element  of  the 
set: 

{OM(|u  -  u|)  |  \/v,u  6  POINTS(r)} 

A  maximum  value  exists  for  this  set,  since  it  has  at  most  four  members: 
0,  negl ,  fin ,  and  in/.12  This  definition  yields  the  following  intuitive  result: 

Proposition  15  Let  T  be  the  qualitative  hyperreal  value  of  a  parameter.  If 
r  is  a  landmark  point,  then  WIDTH(T)  =0.  If  T  is  the  halo  of  a  landmark, 
then  WIDTH(r)  =  negl.  If  T  is  either  inf  or  minf,  then  WIDTH(r)  =  inf. 
Otherwise  WIDTH(r)  =  fin. 

By  using  these  width  values  as  an  index  to  the  distance-rate-time  table 
(figure  3.11),  HR-QSIM  calculates  how  long  each  parameter  can  persist  in 
its  current  qualitative  value. 

Distance-Rate-Time  Table 

The  distance-rate-time  table  (figure  3.11)  determines  the  length  of  time  it 
takes  to  go  some  distance  at  a  given  rate.  An  entry  of  *?’  in  the  table 
indicates  that  inf  fin ,  negl,  or  0  time  may  elapse  (but  see  the  improvements 
in  section  3.3.6).  When  calculating  the  time  that  a  parameter  will  persist  in 
a  qualitative  value,  the  order  of  magnitude  of  the  parameter’s  derivative  and 
the  width  of  the  qualitative  value  are  used  as  indices. 

Predecessor-Persistence  Filtering 

HR-QSIM  calculates  persistence  values  for  two  reasons.  From  the  persis¬ 
tences  of  each  parameter,  one  can  determine  how  long  a  qualitative  state  is 
a  valid  description  of  a  system.  Secondly,  by  comparing  the  persistences  of 
all  the  parameters  in  a  system,  one  can  often  filter  out  inconsistent  transi¬ 
tions  that  were  not  eliminated  by  the  transition  tables  or  constraint  filters. 
Since  the  heat  exchanger  does  not  provide  a  good  illustration,  consider  the 
following  simple  example. 

12It  is  important  to  compute  the  maximum  after  computing  the  order  of  magnitudes, 
rather  than  the  order  of  magnitude  of  the  largest  value,  since  no  maximum  or  least  upper 
bound  for  |»  —  u  need  exist. 
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Figure  3.11:  The  Distance-Rate-Time  Table 

Suppose  the  two  parameters,  X  and  y,  are  both  increasing  at  the  same 
fin  rate,  and  this  rate  is  held  constant.  In  the  predecessor  state,  X  has  the 
landmark  value,  0,  and  Y  has  the  (HALO  0  -)  as  its  value.  Constraint 
filtering  leaves  three  sets  of  possible  transitions: 

Either  X  transitions  off  0  before  Y  changes  to  0: 

[JT(4i+1)]  =  ((HALO  0  +),  ( inc  fin)) 

[y(A+i)]  =  ((HALO  0  —),(inc  fin)) 

Or  y  reaches  0  before  X  leaves  0: 

[*(A+i)l  =  (0, (inc  fin)) 

[y(4+i)j  =  (0 , (inc  fin)) 

Or  they  both  transition  at  the  same  time: 

W4i)l  =  ((halo  0  +),  (inc  fin)) 

[y(A+i)j  =  (0 , {inc  fin)) 

The  question  is,  which  of  these  successor  states  is  possible?  The  answer 
comes  from  analyzing  the  persistence  of  the  predecessor  state.  The  width  of 
X’s  qualitative  value  is  Oand  X  is  moving  with  fin  speed,  so  the  distance-rate¬ 
time  table  lists  Jf’s  persistence  as  0.  Y  has  the  same  rate  and  has  negl  width, 
so  y’s  persistence  is  negl  This  means  that  Y  must  persist  in  its  qualitative 
value  for  longer  than  X.  In  other  words,  X  must  transition  before  V”  and 
only  the  first  of  the  three  transition  sets  shown  above  is  consistent. 

The  general  predecessor-persistence  filtering  algorithm  is  shown  below. 
Inputs  are  two  sets:  parameter  HR-QRs  in  the  predecessor  state  and  HR-QRs 


for  the  proposed  successor  state.  Output  is  a  set  of  possible  persistences  for 
the  predecessor  state  or  the  empty  set  if  the  proposed  successor  is  inconsis¬ 
tent. 


1.  Set  SP  =  the  set  {Q,negl,fin,inf}. 

2.  For  each  parameter,  X 

(a)  Using  X’s  speed  and  the  width  of  its  value  in  the  predecessor  state, 
let  P  =  the  set  of  X's  possible  persistences  from  the  distance-rate- 
time  table. 

(b)  If  X  transitions  from  one  qualitative  state  to  another  from  the 
predecessor  to  the  successor  states,  set  SP  =  SP  intersect  P. 

(c)  Otherwise,  if  X  has  the  same  qualitative  value,  HR-QVAL,  in  the 
predecessor  and  successor  states,  remove  any  time  values  from  SP 
that  are  greater  than  the  largest  value  in  P. 

3.  If  SP  is  empty,  the  successor  state  is  inconsistent,  otherwise  SP  is  the 
set  of  possible  persistences  for  the  predecessor  state. 

3.3.5  Successor-Arrival  Filter 

Like  persistence  values,  arrival  times  are  both  intrinsically  interesting  and 
useful  as  a  means  for  eliminating  inconsistent  transitions  that  have  escaped 
the  scythe  of  other  filters.  This  section  discusses  how  arrival  times  are  used 
in  filtering;  see  section  3.4.1  for  an  explanation  of  how  the  scale  phase  uses 
arrival  values  to  answer  comparative  analysis  questions. 

Successor-arrival  filtering  is  very  similar  to  predecessor-persistence  filter¬ 
ing.  Both  compute  a  qualitative  length,  width  and  distance  respectively,  and 
use  it  as  an  index  to  the  distance-rate-time  table  (figure  3.11).  Likewise, 
both  techniques  use  individual  parameter  times  to  narrow  the  range  of  al¬ 
lowable  times  for  the  state  transition  as  a  whole.  The  difference  between  Hie 
two  techniques  results  from  a  different  focus:  on  the  predecessor  state  for 
persistence  filtering  and  on  the  successor  state  for  arrival  filtering. 
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Distance  Between  Qualitative  Values 

Calculating  the  time  that  a  parameter  takes  to  arrive  at  a  new  qualitative 
value  from  an  old  one  requires  a  notion  of  the  distance  between  the  two 
different  values.  Intuitively,  the  distance  between  two  qualitative  values  is 
the  order  of  magnitude  of  the  minimum  distance  between  any  two  points  in 
the  hyperreal  sets  underlying  the  two  qualitative  values. 

Definition  22  Let  P  be  a  parameter  and  let  T  and  E  be  qualitative  hyperreal 
values  of  P.  Define  the  DISTANCE  between  T  and  E  as  the  minimum  element 
of  the  set: 

{om( |u  -  u|)  |  Vu  G  POINTS(r)  Vu  G  POINTS(E)} 

As  with  the  definition  of  width,  it  is  important  that  the  minimum  operator 
is  applied  after  converting  hyperreal  differences  into  order  of  magnitudes.  As 
one  would  hope,  this  definition  of  distance  behaves  as  required  for  a  metric 
[34];  it  is  symmetric,  obeys  the  triangle  inequality13,  and  the  distance  from 
one  qualitative  value  to  itself  is  guaranteed  to  be  zero. 

Proposition  16  Let  T  and  E  be  qualitative  hyperreal  values  of  a  parameter. 
If  T  is  a  landmark  point  and  E  is  one  of  the  halos  of  the  landmark,  then 
DISTANCE(r,  E)  =  negl.  If  F  is  a  halo  and  E  is  an  adjacent  finite  interval, 
then  DISTANCE(r,E)  =  fin.  Finally,  DISTANCE {<li,infi- ,inf)  -  inf. 

Thus  the  width  of  a  halo  is  negl  while  the  distance  from  the  halo  to  a 
neighboring  finite  interval  is  fin.  This  leads  to  the  conclusion  that  a  param¬ 
eter  starting  from  0  with  fin  speed  may  spend  negl  time  in  (HALO  0  +),  yet 
take  fin  time  to  reach  -;0,  inf>~. 

Successor-Arrival  Filtering 

The  successor-arrival  filtering  algorithm  is  an  enhancement  on  the  predecessor- 
persistence  filter.  The  inputs  are  parameter  HR-QRs  for  the  predecessor  and 
proposed  successor  states.  If  the  successor  state  is  consistent,  then  sets  of 
possible  persistence  and  arrival  times  are  output.  The  trick  is  to  restrict  the 
state  arrival  time,  SA,  with  the  persistence  value  of  an  unchanging  parameter 
and  with  the  arrival  value  of  a  parameter  that  changes. 


1.  Set  SP  =  the  set  {0 ,  negl,  fin,  inf} . 

2.  Set  SA  =  the  set  {negl,  fin,  inf}. 

3.  For  each  parameter,  X 


(a)  Using  X's  speed  and  the  width  of  its  qualitative  value  in  the  pre¬ 
decessor  state,  let  P  =  the  set  of  X's  possible  persistences  from 
the  distance- rate- time  table. 

(b)  Using  Af’s  speed  and  the  distance  from  its  qualitative  value  in  the 
predecessor  state  to  its  value  in  the  successor  state,  let  A  =  the 
set  of  X's  possible  arrivals  from  the  distance- rate-time  table. 

(c)  If  X  transitions  from  one  qualitative  value  to  another  from  the 
predecessor  to  the  successor  states, 

•  Set  SP  =  SP  intersect  P. 

•  Set  SA  =  SA  intersect  A. 

(d)  Otherwise,  if  X  has  the  same  qualitative  value  in  the  two  states, 

•  Remove  any  time  values  from  SP  that  are  greater  than  the 
largest  value  in  P. 

•  Remove  any  time  values  from  SA  that  are  greater  than  the 
largest  value  in  P  (not  A!  Since  this  parameter  is  not  chang¬ 
ing,  the  next  state  must  arrive  while  this  parameter  is  still 
persisting). 

4.  See  section  3.3.6  page  89  for  an  extra  step. 

5.  If  SP  or  SA  is  empty,  the  successor  state  is  inconsistent,  otherwise  SP 
and  SA  are  the  sets  of  possible  persistences  and  arrivals  respectively. 

Heat  Exchanger  Example 

The  heat  exchanger  example  provides  a  nice  illustration  of  successor-arrival 
filtering.  Recall  that  the  transform  phase  gave  the  initial  state  the  following 
HR-QRs: 
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WO)]  =  (x0,(inc  inf)) 

[U(0)j  =  ( infistd ) 

[ <2(0)j  =  (q0,  (dec  fin)) 

[>(0)]  =  (  fo,  (inc  fin)) 

[/*T(0)]  =  (k0,std) 

This  state  can  persist  for  only  a  point  of  time  (denoted  0)  because  several 
parameters  are  moving  from  landmarks.  The  second  state  arrives  in  negl 
time  and  has  new  HR-QRs  for  X,  Q ,  and  F: 

[X^)]  =  ((HALO  x0  +  ),(inc  inf)) 

[Q(Ax)\  =  ((HALO  q0  -),(dec  fin)) 

[F(A)1  =  ((HALO  f0  +  ),(inc  fin)) 


Recall  that  the  constraint  filters  were  unable  to  choose  between  three  pos¬ 
sible  successors  of  this  state.  The  question  was  whether  X  would  transition 
from  its  halo  before,  after  or  at  the  same  time  as  Q  and  F  transitioned  from 
their  halo.  Since  each  parameter  is  in  a  halo,  each  has  a  qualitative  width 
of  negl,  and  since  each  is  moving  towards  a  finite  interval,  each  parameter 
must  travel  a  fin  distance  before  transitioning.  Plugging  these  values  into  the 
distance-rate-tirne  table  leads  to  the  conclusion  that  every  parameter  has  a 
persistence  value  of  negl.  Since  all  parameters  have  the  same  persistence 
value,  the  state  as  a  whole  has  that  persistence:  I.4J  =  negl. 

Using  distance  as  an  index  to  the  distance-rate-time  table  shows  that  .V 
has  a  negl  arrival  value,  but  Q  and  F  have  fin  arrival  values.  Successor- 
arrival  filtering  uses  these  values  to  keep  only  those  successor  states  in  which 
X  transitions  before  Q  and  F.  For  example,  consider  the  successor  in  which 
all  three  transition  at  the  same  time.  This  candidate  would  have  the  following 
HR-QRs: 


WA)]  =  (Xio,fl^,(mc  m/)) 
[Q(A 2)j  =  (<$,qQ>,(dec  fin)) 
[F(A2)}  =  (<fo,0y,(inc  fin)) 


Since  both  X  and  Q  have  transitioned,  SA  =  the  intersection  of  the  sets 
of  their  arrival  times:  {negl}r 1  {fin}  =  0.  Thus  this  successor  is  inconsistent. 
Now  suppose  that  Q  and  F  transition  before  X ;  the  successor  state  would 
have  the  following  HR-QRs: 


(X(.42)]  =  ((HALO  Zo  +  M*rcc  *«/)) 

[QM2)]  =  (-<0  ,q0^,{decfin)) 
[F(Aj)}  =  H/o,0>-,(inc/m)) 


Since  Q  is  transitioning,  SA  is  set  to  its  initial  value  intersected  by  the 
set  of  Q’s  arrival  times;  thus  SA  =  {fin}.  But  since  X  isn’t  changing,  the 
successor  state’s  arrival  time  must  be  less  than  X's  largest  persistence  value, 
negl ,  so  fin  is  not  acceptable.  Once  again,  no  arrival  time  makes  sense  for  this 
successor  state  so  the  successor  is  inconsistent.  The  only  set  of  transitions 
that  pass  the  test  are  the  following;  they  arrive  in  negl  time. 

[X(A2)]  =  (Xx0 ,Q^,(inc  inf)) 

[<?(*42)j  =  ((HALO  ®,-), (dec Jin)) 

[f(-4a)]  =  ((HALO  /0+),(mc  Jin)) 

Since  X's  distance  is  still  fin ,  similar  reasoning  holds  again.  This  state 
persists  for  negl  time  until  X  transitions  to  (HALO  0  -)  and  then  to  0 
(always  arriving  in  negl  time)  while  Q  and  F  remain  in  the  halo  of  their 
original  landmark  values.  Note  the  central  role  of  persistence  calculations 
and  successor- arrival  filtering  in  ensuring  the  correct  result  for  exaggera¬ 
tion.  While  the  enhanced  transition  tables  and  constraint  filtering  are  also 
important,  persistence  and  arrival  filtering  are  responsible  for  deducing  that 
negligible  heat  is  lost  when  oil  moves  infinitely  fast  through  a  heat  exchanger. 

3.3.6  Improving  the  Temporal  Filters 

Although  the  distance-rate-time  table  as  shown  in  figure  3.11  is  sufficient 
to  disambiguate  the  behavior  of  the  infinite  velocity  heat  exchanger,  the 
ambiguity  resulting  from  inf  rate  and  m/distance  is  a  major  liability  in  many 
other  examples.  For  example,  consider  a  block  attached  to  a  stretched  spring 
on  a  frictionless,  horizontal  surface  and  the  comparative  analysis  question 
“What  happens  to  the  period  of  oscillation  when  the  spring  is  made  more 
stiff?” 

Since  the  period  decreases,  we  would  like  exaggeration  to  be  able  to  con¬ 
clude  that  a  system  with  inf  spring  constant  will  have  a  period  of  negl  du¬ 
ration.  However,  this  is  impossible  using  the  distance-rate-time  table  above. 
The  first  step  is  easy — -since  K  =  minf  an  infinite  force  is  applied,  and  the 


equation  F  =  MA  requires  that  acceleration  be  infinite.  The  question  is  how 
long  will  it  take  before  V  arrives  at  in/?  Since  V  is  initially  zero,  it  has  an 
infinite  distance  to  travel,  yet  its  derivative,  ,4,  is  also  inf.  The  ambiguity  of 
the  persistence  table  shown  above  precludes  an  answer.  One  would  like  to 
conclude  that  it  will  only  take  negl  time  for  V  to  reach  infinity,  because  then 
even  the  distance-rate-time  table  above  could  conclude  that  X  will  travel  the 
finite  distance  to  its  rest  position  in  negl  time.  If  it  took  longer  than  negl 
time  for  V  to  transition  to  inf  say  fin  time,  then  it  would  take  at  least  fin 
time  for  X  to  reach  rest  position,  and  the  scale  phase  would  be  unable  to 
definitively  answer  the  comparative  analysis  question. 

Moving  Infinitely  Far,  Infinitely  Fast 

In  fact,  it  is  possible  to  eliminate  the  ambiguity  from  the  distance- rate-time 
table  inf  divided  by  inf  entry,  in  exactly  half  the  cases.  The  determinant 
is  the  direction  of  travel.  There  are  only  two  ways  that  a  parameter  can 
transition  after  travelling  an  infinite  distance— it  must  be  moving  from  inf 
or  minf  to  a  finite  value  or  vice  versa.  If  the  parameter  is  moving  infinitely 
fast  towards  an  infinite  value,  then  the  transition  will  occur  in  negl  time, 
otherwise  it  could  take  negl ,  fin ,  or  even  inf  time. 

Proposition  17  Infinite-Distance-Arrival  Rule 

Let  S{  and  Si+i  be  adjacent  hyperreal  qualitative  states  in  a  behavior.  Let 
P  be  a  parameter.  If  P  has  a  finite  value  in  Si  and  an  infinite  value  in  <S,+j 
and  if  P ’s  qualitative  derivative  has  order  of  magnitude  OM  =  inf  in  S ,,  then 
P  has  negl  arrival  time;  after  negl  time,  P  will  have  reached  an  infinite  value. 

Proof:  Since  the  width  of  P's  qualitative  value  is  fin,  P  has  negl  persistence. 
Let  t0  be  one  of  the  time  points  in  this  open  interval  of  negl  persistence.  Let 
R  be  a  parameter  defined  as: 

R(t)  =  t-t0 

Since  to  was  chosen  from  an  open  interval,  there  are  times  when  P  has  a 
finite  value  and  R  has  a  negligible  value.  Now  consider  which  parameter 
transitions  first:  R  moving  to  a  finite  value  or  P  moving  to  an  infinite  one? 

Since  R's  change  is  an  NS-transition  and  P's  is  a  SN-transition,  propo¬ 
sition  14  states  that  they  cannot  happen  together.  Furthermore,  R  cannot 


transition  before  P  since  R  has  an  arrival  time  of  fin  while  P’s  persistence 
time  is  negl.  Thus  P  must  transition  before  R.  In  other  words, 

3 ti  such  that  HR-QVAL(P(tj))  =  inf  A  HR-QVAL( R(tt))  =  (HALO  0  +) 

Thus  by  definition  of  R  and  (HALO  0  +), 

OM(£i  -  t0)  =  negl 

So  P  must  arrive  in  neql  time  □ 

This  rule  is  both  surprising  and  important  to  exaggeration’s  success.  As 
the  spring  example  hinted,  a  number  of  exaggerated  systems  have  transitions 
that  access  the  inf  divided  by  in/entry  in  the  persistence  table.  Without  the 
disambiguation  provided  by  the  infinite  arrival  rule,  exaggeration  would  solve 
fewer  comparative  analysis  problems. 

In  case  the  preceding  proof  seems  obscure,  the  remainder  of  this  section 
contains  an  intuitive  justification  of  the  rule  that  should  clarify  the  underlying 
phenomena.  In  addition,  I  explain  why  the  rule  doesn’t  apply  to  parameters 
transitioning  in  the  reverse  direction. 

Let  ^  P  =  inf  and  let  P  transition  from  a  finite  value  to  inf.  There  are 
three  cases:  the  arrival  time  could  be  negl,  fin,  or  inf.  Suppose  that  it  doesn’t 
take  nej/time.  Perhaps  instead  it  takes  fin  time  to  transition  to  infinity.  Then 
P  doesn’t  take  on  an  infinite  value  until  some  standard  finite  time,  t0,  has 
passed.  Then  after  time  P  must  still  have  a  finite  value.  But  this  means 
that  even  though  P  has  been  traveling  at  infinite  speed  for  finite  time  to., 
it  has  only  gone  finite  distance.  This  contradicts  the  P  persistence  value 
from  the  original  table.  The  other  possibility  also  produces  a  contradiction. 

If  it  takes  infinite  time  for  P  to  reach  an  infinite  value,  then  P  will  again 
have  traveled  at  most  finite  distance  after  finite  time.  The  only  consistent 
possibility  is  that  the  transition  happens  in  negl  time.  Of  course,  this  is  only 
a  sketchy  argument,  but  it  illuminates  the  formal  proof. 

Note  that  the  argument  does  not  work  when  P  is  transitioning  from  inf  to 
a  finite  value.  Transitions  in  this  direction  can  take  negl,  fin,  or  even  inf  time 
to  arrive.  For  example,  suppose  P  takes  the  finite  time,  t0,  to  reach  a  finite 
value  from  inf.  What  is  P’s  value  after  time  It  is  perfectly  consistent 
that  P  still  be  inf.  By  time  P’s  underlying  hyperreal  value  could  have 


changed  an  infinite  amount  without  a  change  in  qualitative  value  because  the 
inf  qualitative  value  has  an  infinite  width  and  thus  an  arbitrary  persistence.14 


Moving  Negligibly  Far,  Negligibly  Fast 

It  is  also  possible  to  restrict  the  possible  times  taken  to  traverse  a  ntgl  dis¬ 
tance  at  negl  spted.  For  example,  suppose  parameter  P  is  at  landmark  p0  and 
increasing  with  negl  rate.  The  distance-rate-time  table  shows  that  its  persis¬ 
tence  must  be  0,  but  its  arrival  time  for  the  successor  value  (HALO  po  +) 
is  ambiguous  since  negl  distance  is  traversed  at  negl  speed.  In  fact,  the  ar¬ 
rival  time  cannot  be  fin  or  inf- —  it  must  be  negl.  Suppose  that  the  arrival 
time  was  fin ,  that  means  that  fin  time  elapses  before  P  takes  on  a  value  in 
(HALO  Po  +),  but  this  leaves  negl  time  unaccounted  for.  What  value  did  R 
take  for  these  times?  Since  there  are  no  values  between  p0  and  (HALO  p0  +  ), 
an  arrival  value  of  fin  or  inf  results  in  a  contradiction. 

The  reverse  case  results  when  P  has  qualitative  value  (HALO  p0  +  )  and 
is  increasing  towards  ~<Po,  in/^with  negl rate.  Since  the  distance  between 
values  is  fin,  the  arrival  time  is  inf.  The  distance-rate-time  table,  however, 
is  ambiguous  regarding  P’s  persistence  value:  negl,  fin,  and  inf  Are  all  listed 
as  possible.  In  fact,  negl  is  impossible  since  that  would  leave  fin  time  unac¬ 
counted.  P’s  arrival  value  must  be  either  inf  or  fin.  The  following  proposition 
generalizes  these  cases. 

Proposition  18  Temporal  Continuity  Rule 

The  time  for  a  state  St  to  arrive  at  a  successor  5I+1  can  never  be  less 
than  the  persistence  of  Si.  In  addition,  the  arrival  time  can  not  be  more  than 
one  order  of  magnitude  larger  than  the  persistence  time. 

This  rule  is  implemented  as  an  enhancement  to  the  predecessor-persistence 
/  successor- arrival  algorithm  (page  84): 

4.  Remove  any  values  from  SA  that  are  more  than  one  order  of  magnitude 
greater  than  the  largest  value  of  SP.  Remove  any  values  of  SP  that  are 
more  than  one  order  of  magnitude  smaller  than  the  smallest  element 
of  SA. 

l4The  actual  proof  cannot  be  reversed  for  a  similar  reason.  If  P  is  moving  from  an 
infinite  to  a  finite  value  then  the  initial  state’s  persistence  value  is  not  guaranteed  to  be 
negl.  Thus  one  cannot  conclude  that  P  transitions  before  R. 
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3.3.7  Irrelevant-Transition  Filter  * 

For  many  examples,  the  transition  tables  and  filters  described  above  are 
sufficient  to  enable  qualitative  simulation.  Some  examples,  however,  cause 
intractable  branching  if  just  these  filters  are  used.  In  these  cases,  most  every 
state  has  several  successor  states;  the  result  is  an  exponential  number  of 
predicted  behaviors.  Close  inspection  of  these  cases  reveals  that  many  of  the 
transitions  are  irrelevant  —  they  do  not  affect  observable  quantities.  In  fact, 
almost  all  intractable  branching  is  caused  by  predicted  changes  in  the  order 
of  magnitude  of  the  HR-QDIR  of  the  highest  order  derivative  in  the  system. 

For  example,  consider  the  spring  /  block  system  with  negligible  mass. 
Position  is  initially  steady  at  the  landmark  x0 ,  velocity  has  a  HR-QR  of 
(0,(inc  inf))  and  acceleration  has  a  HR-QRof  ( infstd ).  There  is  only  one 
successor: 

[X(.4i)]  =  ((HALO  x0  +), (inc  negl)) 

(V(.Ai)]  =  ((HALO  0  +),  (inc  inf)) 

[4(4i)i  =  (inf,  (dec  negl)) 
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V  will  only  take  negl  time  to  arrive  at  its  successor  value,  -<0 , in/-,  and 
once  it  does,  a  single  unbranching  behavior  will  take  velocity  to  inf  and  po¬ 
sition  to  zero.  Unfortunately,  it  is  perfectly  consistent  that  before  V  reaches 
-«0,  in/-,  A  could  change  qualitative  derivatives  (dec  negl )  to  (dec  fin)  to  ( dec 
inf)  back  to  (dec  fin)  and  so  on,  all  in  negl  time.  Since  each  of  these  states 
lasts  for  negl  time,  the  changes  have  little  physical  significance. 

Of  course,  one  cannot  simply  ban  successor  states  that  differ  only  in 
the  order  of  magnitude  of  some  parameter’s  derivative  —  sometimes  these 
transitions  are  necessary  to  enable  a  later  change  that  is  physically  significant. 
The  trick  is  to  filter  only  the  transitions  which  are  guaranteed  to  be  irrelevant. 
For  example  above,  it  is  reasonable  to  allow  A  to  change  from  (dec  negl)  to 
(dec  fin)  to  (dec  inf)  since  each  of  these  derivative  values  might  enable  an 
interesting  successor.  But  when  A  tries  to  switch  back  to  (dec  fin),  it  is 
reasonable  to  blow  the  whistle.  A  successor  that  repeats  this  previous  state 
cannot  be  a  useful. 

In  general,  the  irrelevant-transition  filter  compares  a  candidate  successor 
state  with  the  immediately  preceding  states.  If  the  candidate  is  equal  to  a 
previous  state  and  all  intervening  states  differ  only  in  the  order  of  magnitude 
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values  of  parameter  derivatives,  then  the  candidate  is  eliminated.  This  ap¬ 
proach  does  not  disconnect  any  possible  states.  If  a  qualitative  state,  St1  is 
part  of  a  behavior  that  fails  to  satisfy  the  filter,  then  there  is  guaranteed  to 
be  a  behavior  that  includes  5,  and  satisfies  the  filter. 

Without  using  the  irrelevant-transition  filter,  exaggeration  would  solve 
far  fewer  problems.  By  using  the  irrelevant-transition  filter,  HR-QSIM  elim¬ 
inates  intractable  branching  in  the  following  problems  (see  appendix  F  for 
details): 

•  Every  spring  /  block  model  with  negl  mass. 

•  Every  spring  /  block  model  with  inf  spring  constant. 

•  The  pendulum  model  with  inf  gravity. 

•  The  projectile  with  decreasing  gravity  and  inf  initial  velocity. 

3.3.8  Summary 

Exaggeration  largely  reduces  a  comparative  analysis  problem  to  the  problem 
of  simulating  a  system  with  parameters  using  a  qualitative  hyperreal  repre¬ 
sentation.  Since  comparative  analysis  is  a  challenging  task,  one  should  not 
be  surprised  that  the  process  of  hyperreal  qualitative  simulation  is  difficult. 
This  section  described  one  way  to  build  such  a  simulator.  QSIM  was  taken 
as  the  base  for  exaggeration’s  simulate  phase,  because  of  its  availability,  ef¬ 
ficiency  and  precise  specification.  However,  the  techniques  described  in  this 
section,  are  applicable  to  all  qualitative  simulation  approaches: 

•  Exploiting  hyperreal  continuity,  by  distinguishing  0C-,  C0-,  NS-,  and 
SN-transitions, 

•  Enforcing  order  of  magnitude  consistency  in  corresponding  values  and 
derivatives, 

•  Predecessor-persistence  filtering  with  the  width  of  predecessor  qualita¬ 
tive  values  as  an  index  to  the  distance-rate-time-table, 

•  Successor-arrival  filtering  with  the  distance  between  predecessor  and 
successor  qualitative  values  as  an  index,  and  the 


•  Infinite-distance  rule  to  disambiguate  the  distance-rate-time  table, 


The  computational  complexity  of  exaggeration  in  general  and  the  simulate 
phase  in  particular  is  addressed  in  section  4.4.  The  possible  advantages  of 
other  approaches  to  qualitative  simulation  are  discussed  in  section  5.  The 
next  section  concludes  the  basic  presentation  of  the  exaggeration  algorithm 
by  describing  how  the  scale  phase  interprets  the  simulate  phase  results  to 
answer  comparative  analysis  questions. 


3.4  Scale  Phase 

The  scale  phase  answers  comparative  analysis  questions  by  comparing  a  stan¬ 
dard  behavior  of  the  original  system  (figure  3.12)15  with  the  hyperreal  be¬ 
havior  (figure  3.13)  that  HR-QSIM  produces  from  the  transformed  initial 
conditions.  If  the  behaviors  are  qualitatively  different,  i.e.  have  different 
qualitative  values,  then  the  comparative  analysis  question  can  often  be  an¬ 
swered. 
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Figure  3.12:  Behavior  of  a  Standard  Heat  Exchanger 


15This  figure  uses  square  brackets  to  denote  QSIM’s  qualitative  representation,  not 
HR-QRS. 
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StateSa'  [-Y(O)]  =  (x0,(inc  inf)) 

W(O)]  =  (go ,  (dec  fin)) 

[F(0)j  =  (  fo,  (inc  fin)) 
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Figure  3.13:  Behavior  of  an  Infinite  Flow  Rate  Heat  Exchanger 

The  scale  phase’s  first  task  is  to  choose  what  to  compare  in  the  two  be¬ 
haviors;  this  depends  on  the  specific  comparative  analysis  question.  If  the 
question  is  one  of  a  parameter’s  relative  change  value  at  an  event,  the  scale 
phase  must  match  events.  If  the  question  concerns  the  duration  of  a  time  in¬ 
terval,  then  the  scale  phase  must  match  events  that  start  and  end  the  interval. 
In  both  cases,  an  abstract  description  of  corresponding  events  is  required.  In 
the  EXAG  implementation  this  description  is  simply  the  conjunction  of  par¬ 
tial  specifications  for  the  HR-QRs  of  one  or  more  parameters.  For  example, 
one  can  specify  the  event  when  the  hot  oil  exits  the  heat  exchanger  by  spec¬ 
ifying  that  X  equal  the  landmark  zero.  By  leaving  its  qualitative  derivative 
unspecified,  this  description  specifies  a  qualitative  state  in  both  the  original 
and  exaggerated  behaviors,  (£3)  and  ( Se )  respectively. 

Since  the  comparative  analysis  question  asked  what  happens  to  the  heat 


of  the  oil  as  it  exits,  the  qualitative  value  of  parameter  Q  is  now  compared 
in  the  two  states.  In  S3,  Q  =  (0,  go)  while  Q  —  (HALO  q0  — )  in  the  Se;  thus 
heat  is  greater  in  the  exaggerated  behavior.  Since  an  extreme  increase  in 
velocity  caused  a  noticeable  increase  in  output  heat,  the  scale  phase  concludes 
that  any  increase  in  velocity  will  cause  some  increase  in  output  heat.  While 
this  conclusion  is  not  guaranteed  sound,  it  is  frequently  correct.  Section 

4.3.1  explains  the  conditions  that  cause  faulty  predictions,  while  the  rest  of 
this  section  considers  two  remaining  details  in  the  scale  phase  algorithm: 
questions  about  durations  and  cases  when  the  simulate  phase  predicts  more 
than  one  possible  exaggerated  behavior. 

3.4.1  Scaling  Durations 

Answering  comparative  analysis  questions  about  changes  in  the  time  dura¬ 
tion  between  two  events  requires  the  ability  to  measure  lengths  of  behavioral 
fragments  for  standard  and  exaggerated  systems.  Recall  that  standard  be¬ 
haviors  alternate  between  states  persisting  for  closed  time  points  and  ones 
lasting  for  open  intervals  of  standard  real  duration.  This  implies  that  there 
is  a  finite,  noninfinitesimal  time  between  any  two  events  that  do  not  occur 
in  the  same  standard  state. 

The  time  is  easy  to  measure  in  exaggerated  behaviors  as  well,  because 
HR-QSIM’s  successor-arrival  filtering  step  computes  arrival  times  for  each 
state.  All  that  is  required  is  a  means  of  adding  the  times  from  individual 
states  to  determine  the  length  of  a  whole  behavioral  fragment.  Qualitative 
addition  of  times  is  defined  in  by  the  table  of  figure  3.14;  notice  that  this  is 
just  the  maximum  operator. 
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Figure  3.14:  Temporal  Addition 


The  scale  phase  answers  questions  about  durations  by  comparing  the 
elapsed  time  between  corresponding  events.  For  example,  consider  the  straight¬ 
forward  comparative  analysis  question  “Does  the  oil  exit  the  pipe  sooner  if  if 
moves  faster?”  Event  descriptions  of  X  =  x0  and  X  =  0  specify  the  starting 
and  ending  states  S i  and  S 3  in  the  standard  behavior  and  Sa  and  Se  in 
the  exaggerated  one.  Since  S\  -f  S3  the  standard  oil  remains  in  the  heat 
exchanger  for  finite  time.  Since  the  arrival  times  of  the  states  between  Sa 
and  Se  are  all  negl ,  temporal  addition  concludes  that  the  oil  requires  negli¬ 
gible  time  to  leave  the  heat  exchanger  when  the  flow  rate  is  infinite.  Since 
negl  <  fin,  the  scale  phase  concludes  that  in  general,  the  oil  will  exit  sooner 
if  the  flow  rate  is  increased. 

One  might  ask  why  arrival  times  are  used  rather  than  adding  the  persis¬ 
tence  values  for  the  relevant  states.  The  reason  that  arrival  values  are  the 
relevant  metric  is  because  the  question  is  how  long  does  it  take  to  reach  the 
state  of  interest.  For  the  heat  exchanger  example  it  makes  little  difference 
whether  arrival  or  persistence  times  are  used,  but  consider  the  case  of  a  pro¬ 
jectile  moving  at  constant,  fin  speed.  How  long  does  it  take  to  reach  in/ from 
zero?  There  are  two  intervening  qualitative  values:  (HALO  0  +  )  and  -<0, 
infy.  The  sum  of  the  persistences  is:  0 +fin=fin,  while  the  sum  of  the  arrival 
times  is  negl+inf=inf.  This  latter  answer  is  clearly  the  intuitive  one. 

Since  there  is  still  ambiguity  in  the  distance-rate-time  table  even  with  the 
infinite  arrival  rule,  some  states  may  not  have  firm  arrival  values.  In  these 
cases,  it  can  be  impossible  to  determine  the  exact  length  of  an  exaggerated 
behavioral  fragment,  so  the  scale  phase  may  not  be  able  to  answer  the  com¬ 
parative  analysis  question.  If  one  of  the  other  states  in  the  fragment  has  an 
inf  arrival  value,  however,  then  one  can  conclude  thrt  the  whole  behavior 
will  persist  for  inf  time  even  if  some  states  are  ambiguous.  Thus  temporal 
ambiguity  in  individual  states  does  not  necessarily  doom  the  scale  phase. 

3.4.2  Multiple  Behaviors 

The  preceding  discussion  finessed  one  point  —  it  assumed  that  there  was 
only  one  standard  and  one  exaggerated  behavior.  Since  frequently  neither 
of  these  assumptions  is  true,  the  scale  phase  algorithm  is  more  complicated. 
For  example,  QSIM  predicts  three  behaviors  for  the  standard  heat  exchanger. 
Figure  3.12  represents  the  behavior  in  which  the  oil  exits  before  reaching 
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thermal  equilibrium,  but  behaviors  in  which  thermal  equilibrium  is  reached 
before  the  oil  exits  and  exactly  when  the  oil  exits  are  also  possible.  Although 
HR-QSIM  predicts  a  unique  behavior  for  the  infinite  rate  heat  exchanger, 
this  is  not  the  case  for  all  examples. 

Thus,  the  scale  phase  can’t  necessarilly  just  compare  the  value  of  a  pa¬ 
rameter  from  a  single  standard  behavior  to  a  single  exaggerated  behavior. 
Two  possibilities  exist:  compare  all  exaggerated  behaviors  to  some  specific 
standard  behavior  or  compare  all  standard  behaviors  pairwise  with  the  ex¬ 
aggerated  behaviors.  The  current  implementation  does  the  former.  Just  as 
DQ  analysis  makes  use  of  information  implicit  in  the  modeler’s  choice  of  a 
single  behavior  (section  2.5),  exaggeration  also  benefits  from  this  constraint. 
For  the  question  “What  happens  to  output  temperature  if  the  flow  rate  is 
increased?”,  the  choice  of  initial  behavior  is  irrelevant;  all  three  standard 
behaviors  predict  that  heat  will  decrease  a  finite  amount  while  it  decreases 
negligibly  in  the  exaggerated  behavior. 

To  see  how  the  modeler’s  selection  of  an  initial  standard  behavior  facil¬ 
itates  exaggeration,  consider  the  question  “What  happens  to  output  tem¬ 
perature  when  thermal  conductivity,  K,  is  increased?"  HR-QSIM  generates 
a  single  behavior  which  predicts  that  with  K  =  minf,  heat  transitions  to 
zero  in  negl  time.  In  other  words,  thermal  equilibrium  is  reached  long  before 
the  oil  exits  the  pipe.  But  two  of  the  three  standard  QSIM  behaviors  also 
predicted  that  there  would  be  zero  heat  as  the  oil  left  the  pipe.  Unless  the 
modeler  chooses  the  standard  behavior  in  which  the  oil  exits  before  reaching 
thermal  equilibrium,  the  scale  phase  would  have  no  qualitative  difference  on 
which  to  base  an  answer.  By  matching  against  a  single  standard  behavior, 
exaggeration  takes  advantage  of  the  knowledge  in  the  mind  of  the  human 
who  chose  the  initial  behavior  and  ambiguity  is  reduced. 


3.5  Summary 

Exaggeration  solves  comparative  analysis  problems  in  a  manner  fundamen¬ 
tally  different  from  DQ  analysis  —  by  converting  the  comparative  analysis 
problem  into  a  new  simulation  problem  and  analyzing  the  result.  The  process 
is  divided  into  three  phases:  transform,  simulate,  and  scale.  This  chapter 
traced  exaggeration’s  performance  on  the  question  “What  happens  to  the 
output  temperature  of  hot  oil  in  a  heat  exchanger  when  the  oil’s  flow  rate  is 

96 


increased?”  The  transform  phase  constructed  the  model  of  a  heat  exchanger 
where  the  oil  moved  infinitely  fast.  The  simulate  phase  (implemented  as  the 
HR-QSIM  algorithm)  predicted  that  oil  in  this  model  would  leave  after  cool¬ 
ing  only  a  negligible  amount.  Finally,  the  scale  phase  compared  the  results 
from  the  standard  and  hyperreal  qualitative  simulations  and  noticed  that  the 
output  temperature  was  qualitatively  higher  in  the  exaggerated  case;  it  then 
concluded  that,  in  general,  increases  in  velocity  cause  increases  in  output 
temperature. 

This  section  concentrated  on  the  technical  details  of  the  exaggeration 
algorithm,  in  particular  how  HR-QSIM  works.  The  qualitative  hyperreal 
representation  was  introduced  and  used  to  motivate  changes  to  the  QSIM  al¬ 
gorithm.  Predecessor-persistence  and  successor-arrival  filtering  were  shown 
to  be  critical  to  hyperreal  simulation  in  two  ways:  they  both  compute  impor¬ 
tant  temporal  information  about  each  qualitative  state  and  they  eliminate 
many  inconsistent  transitions,  restricting  the  number  of  proposed  qualitative 
behaviors. 

The  next  chapter  compares  exaggeration  to  DQ  analysis  on  many  dimen¬ 
sions:  theoretical,  competence,  computational  performance,  and  explanatory 
quality.  Unlike  DQ  analysis,  exaggeration  is  shown  to  be  unsound;  it’s  an¬ 
swers  are  not  always  correct.  Like  DQ  analysis,  exaggeration  is  incomplete. 
Neither  technique  can  solve  all  comparative  analysis  problems.  Exaggera¬ 
tion,  however,  appears  to  solve  a  larger  class  of  problems  than  DQ  analysis; 
the  reasons  for  this  are  discussed. 
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Chapter  4 

Analysis  of  Techniques 


This  chapter  compares  the  techniques  of  DQ  analysis  and  exaggeration  along 
several  dimensions:  their  theoretical  foundation  (section  4.2),  their  ability  to 
answer  comparative  analysis  questions  correctly  (section  4.3),  their  algorith¬ 
mic  complexity  (section  4.4),  and  the  quality  of  the  explanations  that  they 
produce  (section  4.5).  First,  however,  the  similarities  between  the  techniques 
are  discussed. 


4.1  Similarities  and  Shared  Problems 

The  qualitative  nature  of  both  DQ  analysis  and  exaggeration  is  both  the  key 
to  their  power  and  the  cause  of  their  shared  weaknesses.  Several  classes  of 
questions  stump  both  techniques;  in  these  cases,  the  reason  is  always  that  the 
qualitative  abstraction  is  inappropriate  for  the  problem  at  hand.  The  cases 
are  divided  into  three  groups:  questions  that  are  fundamentally  ambiguous, 
questions  that  result  in  ambiguity  from  qualitative  arithmetic,  and  questions 
that  depend  on  the  distinction  between  linear  and  monotonic  functions. 

4.1.1  Ambiguous  Questions 

Some  questions  simply  don’t  contain  enough  information  to  be  answerable. 
For  example,  neither  DQ  analysis  nor  exaggeration  could  answer  the  question 
“What  would  happen  to  the  period  of  oscillation,  if  the  mass  of  the  block 
was  heavier  and  the  spring  was  more  stiff?”  because  there  is  no  answer  to 
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this  question  as  stated.  The  increased  mass  tends  to  increase  the  period,  but 
the  increased  spring  constant  tends  to  decrease  it.  Thus  the  duration  might 
increase,  decrease  or  remain  unchanged. 

Neither  technique  answers  incorrectly;  they  both  terminate  without  gen¬ 
erating  an  answer.  It  would  be  nice  if  my  techniques  could  tell  that  there 
was  no  answer  and  complain  that  the  question  was  poorly  phrased,  but  as  it 
is,  neither  exaggeration  nor  DQ  analysis  recognizes  that  the  difficulty  is  in 
the  question  rather  than  inadequate  reasoning  abilities. 

4.1.2  Qualitative  Arithmetic  is  Ambiguous 

Since  DQ  analysis  and  exaggeration  use  the  same  qualitative  arithmetic  uti¬ 
lized  by  other  forms  of  qualitative  reasoning,  it  should  not  be  surprising  that 
ambiguity  causes  a  problem  here  as  well. 

The  model  of  a  projectile  fired  from  a  cannon  in  a  uniform  gravitational 
field  serves  to  demonstrate  the  problems  due  to  qualitative  arithmetic.  Nei¬ 
ther  technique  can  deduce  that  the  time  to  apogee  will  not  change  if  the 
projectile  mass  is  increased.  The  culprit  is  inherent  ambiguity  of  qualitative 
values —  relative  change  values  do  not  form  a  group  under  multiplication 
[40]  and  thus  there  are  not  guaranteed  inverses.  This  affects  DQ  analysis  as 
follows.  Since  M  is  increased  but  G  remains  unchanged,  F  =  MG  leads  to 
the  conclusion  that  Fff.  But  what  is  the  relative  change  value  for  accelera¬ 
tion?  F  =  MA  results  in  ambiguity  because  there  is  no  unique  value  for  ff 
divided  by  ff.  Exaggeration  faces  the  same  problem:  if  mass  is  infinite,  then 
force  must  be  also.  But  since  there  is  no  unique  value  for  inf  divided  by  inf , 
acceleration  could  be  negl,  fin ,  or  inf.  This  problem  affects  all  qualitative 
reasoning  systems;  qualitative  simulation  programs  have  the  same  problem 
as  those  for  comparative  analysis. 

Another  example,  the  oscillating  spring  /  block  clearly  shows  the  parallel. 
Although  both  techniques  deduce  that  increasing  mass  will  increase  the  time 
taken  from  an  initial  extreme  until  the  first  transition  ( X  =  0)  is  reached, 
neither  technique  can  deduce  that  the  whole  period  will  increase  in  length 
(without  explicit  equations  for  energy  conservation  in  the  model).  Because  of 
the  qualitative  arithmetic,  DQ  analysis  is  unable  to  show  that  AT [|2,  i.e.,  that 
X  sweeps  out  the  same  distance  when  the  mass  is  increased.  Because  of  this, 
X  is  not  known  to  be  a  covering  perspective  so  the  derivative  and  duration 


theorems  can  not  be  used.  Thus  there  is  no  way  to  determine  the  RC  value  for 
the  second  quarter  of  the  period.  Exaggeration  displays  the  same  problem 
of  ambiguity  in  the  temporal  filtering  algorithms.  With  an  infinite  mass, 
acceleration  is  negligible  and  velocity  is  transitioning  from  a  negligible  value 
towards  zero.  Since  the  qualitative  value  of  velocity  has  negl  width  and  the 
distance  to  the  qualitative  value  is  also  negl ,  neither  predecessor-persistence 
nor  successor-arrival  filtering  can  say  whether  the  transition  will  take  negl , 
fin ,  or  (the  correct  answer)  inf  time. 

This  problem  is  directly  analogous  to  QSIM’s  prediction  of  spurious  be¬ 
haviors  [27].  Given  a  Hooke’s  law  description  of  the  spring/block,  QSIM 
produces  many  possible  behaviors  in  addition  to  the  correct  description  of 
stable  oscillation.  Furthermore,  both  the  DQ  problem  and  exaggeration’s 
impotence  can  be  alleviated  in  the  same  way  that  Kuipers  caused  QSIM  to 
disregard  behaviors  other  than  stable  oscillation — by  augmenting  the  struc¬ 
tural  description  with  equations  describing  conservation  of  energy.  DQ  anal¬ 
ysis,  for  example,  can  deduce  that  since  potential  energy  is  equal  to  force 
times  distance,  increasing  the  block’s  mass  leaves  total  energy  unchanged. 
This  allows  it  to  recognize  X  as  a  covering  perspective  and  deduce  that  the 
duration  increases  for  each  of  the  period’s  four  transition  intervals.  Similarly, 
exaggeration  can  perform  persistence  and  arrival  filtering  on  the  additional 
parameters  to  conclude  that  it  takes  inf  time  for  the  block  to  reach  it’s  ex¬ 
treme  position. 

The  problem  of  ambiguous  qualitative  arithmetic  is  an  important  area  for 
future  work.  One  approach  is  inspired  by  the  success  of  the  manual  inclusion 
of  redundant  (conservation)  equations;  perhaps  it  would  be  appropriate  for 
programs  to  perform  some  symbolic  algebraic  manipulation  before  generating 
qualitative  solutions  [47].  Struss  [40]  has  shown  that  care  must  be  exercised 
in  this  activity,  since  small  changes  in  the  form  of  qualitative  equations  fre¬ 
quently  result  in  radical  changes  to  their  solutions.  Dormoy  and  Raiman  [14] 
recently  demonstrated  the  qualitative  Gauss  rule,  a  type  of  algebraic  manip¬ 
ulation  that  is  solution  preserving.  While  it  cannot  eliminate  all  problems 
with  ambiguity,  it  would  help  with  the  projectile  problem  above.  Incorpora¬ 
tion  of  a  limited  algebraic  reasoner  into  qualitative  reasoning  systems  seems 
very  promising. 


A  second  problem  faced  by  both  DQ  analysis  and  exaggeration  is  the  insen¬ 
sitivity  of  qualitative  techniques  to  the  difference  between  a  linear  function 
and  one  which  is  simply  monotonic.  For  example,  given  the  Hooke’s  law 
description  of  an  oscillating  spring  and  block  on  a  frictionless,  horizontal  sur¬ 
face  (F  =  -KX),  neither  technique  can  answer  the  question  “What  happens 
to  the  period  of  oscillation  if  the  amplitude  is  increased?” 

In  fact,  the  answer  is  that  the  period  does  not  change,  but  exaggera¬ 
tion  can  not  predict  this  because  of  ambiguity  in  the  successor-arrival  and 
predecessor-persistence  filters.  The  transform  phase  constructs  an  initial 
state  with  infinite  displacement,  and  constraint  propagation  concludes  that 
force  and  acceleration  must  also  be  infinite.  The  infinite  arrival  rule  predicts 
that  velocity  will  transition  to  infinity  in  negligible  time,  but  then  ambiguity 
sets  in.  With  V  =  inf  the  question  is  how  long  will  it  take  X  to  move  from 
inf  to  zero?  Unfortunately,  the  distance-rate-time  table  is  ambiguous  and 
the  infinite-distance  rule  (proposition  17)  does  not  apply  since  X  is  moving 
from  infinity  rather  than  to  infinity.  It  could  take  negl,  fin ,  or  inf  time  for  X 
to  transition  and  HR-QSIM  cannot  determine  which. 

DQ  analysis  cannot  solve  the  question  either,  apparently  for  a  very  dif¬ 
ferent  reason:  no  useful  perspective  exists  to  enable  the  duration  rule.  There 
is  no  system  parameter  P  such  that  V||£tl).  Clearly  X  won’t  work  as  a  per¬ 
spective,  since  it  doesn’t  sweep  out  the  same  range  in  the  two  cases.  In  fact, 
it  is  easy  to  prove  that  no  artificial  perspective  could  satisfy  the  equation. 

Proposition  19  Given  the  definition  ofV  as  specified  above  for  the  spring/block 
example  with  ATff0,  let  tt  =  T( 71)  and  =  T( h).  There  are  no  continuous , 
real  valued,  functions  P ,  P  such  that 

P( 0)  =  P(0)  =  p0  A 

P(h)  =  P(h)=Pi  A 

v(P-'(p))  =  v(p-'(p))Vpe(p0,Pi) 

Proof:  Since  Xf|-„,  initial  potential  energy  is  higher  in  the  perturbed  system, 
so  kinetic  energy  is  greater  at  71.  This  means  that  V'fti,  i.e., 

V(fi)  =  v[>  vi  =  Viti) 

Because  V  and  V  are  continuous 
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Similarly, 


lim  P~l{p)  =  pi 

p— pi 

and 

lim  P^ip)  =  Pi 
p-*p  i 

Thus 

lim(K(^(p))  -  V(P~l(p)))  =  vi  -  vi  ±  0 

p— pi 

So  there  exists  some  9  €  (po?Pi)  such  that 

=  V(p-'(q)) 

□ 

Thus  there  is  no  function,  P,  that  can  act  as  a  perspective  such  that 
KIlJ,!,.  This  really  shouldn’t  be  very  surprising.  After  all,  the  block  really 
does  move  faster.  The  only  reason  that  the  period  is  unchanged  is  that  the 
increased  velocity  is  exactly  counterbalanced  by  the  increased  distance  the 
block  must  travel.  It  would  be  foolish  to  try  and  claim  the  velocity  doesn’t 
increase  when  it  does.  Instead,  an  intuitive  explanation  should  account  for 
the  balance  of  the  change  in  velocity  and  distance. 

This  type  of  explanation  is  outside  the  realm  of  current  theories  of  qual¬ 
itative  physics  because  it  depends  on  the  fact  that  Hooke’s  law  is  a  linear 
equation.  Nonlinear  oscillators,  like  pendulums,  do  change  their  period  when 
amplitude  is  changed.  Because  qualitative  techniques  do  not  distinguish  be¬ 
tween  linear  and  nonlinear,  yet  monotonic,  functions,  they  are  incapable  of 
solving  questions  that  depend  on  those  distinctions.  Future  work  might  in¬ 
vestigate  the  possibility  of  explicit  reasoning  about  linear  equations,  and  the 
related  issue  of  symmetry. 
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4.2  Theoretical  Difference 

This  section  considers  several  questions  relating  to  the  theoretical  difference 
between  exaggeration  and  DQ  analysis.  What  are  the  techniques  doing? 
Why  do  they  perform  differently?  Can  either  technique  substitute  for  the 
other  if  augmented  with  additional  knowledge  or  assumptions?  The  short 
answers  are  that  the  two  techniques  are  fundamentally  different.  While  each 
technique  can  be  augmented  to  simulate  the  other,  the  assumptions  required 
are  not  always  realistic. 


4.2.1  Predicting  Partial  Derivatives 

Since  the  relative  change  notation  expresses  how  a  parameter  changes  given 
an  initial  perturbation,  it  is  natural  to  ask  about  its  relationship  to  the  stan¬ 
dard  mathematical  tools  for  expressing  relative  change:  partial  derivatives. 
In  the  following  proposition  it  is  handy  to  think  of  parameter  C  as  the  cause, 
and  E  as  an  effect. 


Proposition  20  If  C^0  and  all  other  independent  and  boundary  condition 
parameters  have  an  RC  value  of  ||0  and  Ety0  then 


dE  n 

w<0 

at  time  zero. 


This  statement  can  be  extended  to  any  transition,  7 ;,  by  normalizing 
with  respect  to  time.  While  the  relationship  between  RC  values  and  partial 
derivative  is  straightforward  for  values  at  transition  points,  the  connection  is 
more  subtle  for  interval  RC  values  because  of  the  presence  of  perspectives. 


Exaggeration  Requires  Monotonicity 

Although  both  techniques  try  to  find  the  sign  of  the  partial  derivative  of 
one  parameter  with  respect  to  another,  they  do  it  in  different  ways.  DQ 
analysis  computes  the  partial  derivative’s  sign  directly,  while  exaggeration 
approximates  the  partial  derivative  by  evaluating  the  equation  at  an  asymp¬ 
tote  and  returning  the  slope  of  a  straight  line  though  this  limiting  value  and 
the  original  point. 
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To  understand  these  points,  it  is  useful  to  consider  examples  that  are 
even  simpler  than  the  heat  exchanger.  The  question  of  partial  derivatives 
is  complicated  by  the  fact  that  the  heat  exchanger  parameters  are  defined 
with  differential  equations  and  change  over  time.  Comparative  analysis  seeks 
the  partial  derivative  of  the  solution  of  the  differential  equation  model.  By 
considering  simple  algebraic  equations  instead  of  differential  equations,  the 
problem  of  solving  the  equations  is  eliminated  and  the  fundamental  difference 
between  DQ  analysis  and  exaggeration  illuminated. 

For  example,  consider  the  equation: 

Y  =  5  +  ^ 

.A 

A  simple  comparative  analysis  question  would  be  “What  happens  to  Y  if 
X  is  increased?”  In  other  words,  what  is  the  sign  of  |^?  DQ  analysis  solves 
this  by  propagating  the  perturbation  through  the  equation:  if  Xff  then 
Since  5||,  DQ  analysis  concludes  that  Y (1.  Exaggeration,  on  the  other  hand, 
evaluates  the  equation  to  find  y’s  value  when  X  is  inf.  Because  =  negl, 
this  asymptotic  value  for  Y  is  lower  than  its  current  value.  The  scale  phase 
concludes  that  the  qualitative  partial  derivative  is  1). 


EXAG  Predicts 


Current  Value 


Current  Value  Inf  Current  Value 


Figure  4.1:  Exaggeration  Approximates  a  Curve  with  a  Line  through  an 
Asymptote 

Since  the  scale  phase  can  be  thought  of  as  approximating  the  partial 
derivative  by  drawing  the  slope  of  a  straight  line  between  the  current  and 
asymptotic  values  (figure  4.1),  it  might  appear  that  exaggeration  would  pro¬ 
duce  sound  answers  only  for  linear  systems.  However,  since  comparative 
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analysis  only  requires  the  sign  of 'the  partial  derivative,  exaggeration  only  re¬ 
quires  that  a  system  respond  monotonically  to  the  perturbation,  not  linearly. 


4.2.2  Predicting  Asymptotes 

As  the  previous  section  considered  what  assumptions  were  necessary  to  guar¬ 
antee  that  ex  ''geration  correctly  predict  qualitative  partial  derivatives,  it  is 
natural  to  ask  what  knowledge  must  be  added  to  DQ  analysis  to  achieve 
exaggeration’s  ability  to  predict  asymptotic  values.  Consider  the  following 
two  equations: 


r  =  8  +  I 

As  X  tends  towards  inf,  Y  takes  on  different  values  in  these  two  equa¬ 
tions,  yet  the  partial  derivative  (and  hence  the  relative  change  value  predicted 
by  DQ  analysis)  is  the  same.  Given  a  quantitative  representation,  the  as¬ 
sumption  of  linearity  would  allow  one  to  predict  F’s  value  for  any  value  of 
X.  However,  a  linearity  assumption  is  not  strong  enough  for  prediction  of 
asymptotic  values  given  a  qualitative  representation.  The  relative  change 
value  predicted  by  DQ  analysis  can  accurately  predict  an  asymptotic  value 
only  when  the  function  is  constant.  This  case  is  so  trivial,  it  is  unlikely  to 
be  useful. 

This  analysis  shows  the  theoretical  relationship  between  the  two  tech¬ 
niques,  yet  the  question  remains:  “For  any  given  problem,  which  technique 
will  work  better?”  The  next  section  discusses  this  issue. 


4.3  Competence  Difference 

There  are  several  possible  meanings  to  the  question  “Which  technique  works 
better?”  Here  I  consider  competence:  “When  does  each  technique  work?”  An 
ideal  answer  would  be  a  characterization  of  the  sets  of  comparative  analysis 
questions  that  each  technique  correctly  solves.  Although  this  discussion  is 
not  that  precise,  it  does  illuminate  the  reasons  for  differences  in  competence. 


Neither  technique  is  strictly  stronger  —  each  has  advantages  that  enables  it 
to  out  perform  the  other  on  a  subclass  of  problems.  The  discussion  starts 
with  questions  that  stump  exaggeration  and  then  consideres  the  weaknesses 
of  DQ  analysis. 


4.3.1  Weaknesses  of  Exaggeration 

The  first  difference  in  competence  was  introduced  in  the  previous  section: 
nonmonotonicity.  The  following  simple  algebraic  example  shows  exaggera¬ 
tion’s  weakness  with  nonmonotonic  systems. 

Y  =  X  +  ~ 

A 

DQ  analysis  is  unable  to  answer  the  question  “What  happens  to  ir  if  X  is 
increased?”  because  of  ambiguity:  Since  A" ft  and  yll,  the  sum  i»  indetermi¬ 
nate.  This  is  as  it  should  be;  the  answer  depends  on  the  original  quantitative 
value  of  X  and  is  thus  outside  qualitative  reasoning. 

Exaggeration,  however,  willingly  supplies  an  answer.  If  X  ~  inf  then 
y  =  negl  so  Y  =  inf  thus  by  approximating  the  curve  with  a  straight  line, 
the  scale  phase  would  conclude  that  increasing  X  increases  Y  (figure  4.2a) 
and  hence  decreasing  X  decreases  Y.  But  if  the  transform  phase  exaggerated 
X  to  an  infinitesimal  value,  then  y  would  equal  inf  so  Y  would  equal  inf. 
This  would  suggest  the  opposite:  that  increasing  X  decreases  V.  The  results 
are  inconsistent;  whichever  transformation  exaggeration  makes  will  result  in 
an  incorrect  answer  for  some  initial  value  of  X. 

While  it  is  easy  to  check  the  monotonicity  of  an  algebraic  equation  by 
finding  the  roots  of  its  derivative,  there  is  no  easy  way  to  ensure  monotonic¬ 
ity  of  the  solution  of  an  arbitrary  system  of  differential  equations.  The  trick 
of  exaggerating  in  both  directions  suffices  to  detect  simple  types  of  nonmono¬ 
tonicity  with  one  inflection  point,  but  fails  to  detect  nonmonotonic  functions 
like  cubic  equations  (figure  4.2b).  Perhaps  the  only  way  to  verify  exaggera¬ 
tion’s  soundeness  would  be  to  step  out  of  qualitative  reasoning  and  solve  the 
differential  equations  using  standard  algebraic  techniques.  For  linear  equa¬ 
tions,  a  closed  form  solution  would  be  easily  obtainable.  If  the  equations 
were  nonlinear,  Sacks’  PLR  program  [36,35]  could  be  used  to  generate  and 
solve  a  piecewise  linear  approximation.  Although  neither  of  these  techniques 


Figure  4.2:  Nonmonotonic  Systems  can  Fool  Exaggeration 


generates  explanations,  they  could  be  used  to  check  monotonicity  and  thus 
validate  exaggeration’s  predictions. 

4.3.2  Weaknesses  of  DQ  Analysis 

While  DQ  analysis,  unlike  exaggeration,  is  guaranteed  to  answer  CA  ques¬ 
tions  correctly,  it  is  common  for  DQ  analysis  to  produce  no  answer  at  all. 
Exaggeration  can  correctly  solve  many  problems  that  are  too  difficult  for 
DQ  analysis.  An  example  of  a  projectile  fired  from  a  cannon  illustrates  this 
point.  Given  an  increase  in  muzzle  velocity,  Vff0,  as  a  perturbation,  DQ 
analysis  predicts  that  apogee  will  occur  later,  but  is  unable  to  predict  that 
the  projectile  will  rise  higher  or  take  longer  to  fall  back  to  the  ground.  If 
energy  conservation  equations  are  added  explicitly,  then  DQ  analysis  reaches 
the  correct  conclusion.  However,  exaggeration  gets  the  right  answer  to  all 
these  questions  without  requiring  energy  conservation  equations. 

If  one  considers  a  more  realistic  projectile  model  in  which  gravity  dimin¬ 
ishes  with  increasing  altitude,  then  DQ  analysis  fails  to  conclude  any  of  the 
three  results  —  even  with  energy  conservation  equations.  Exaggeration,  on 
the  other  hand,  correctly  answers  all  three. 

Why  does  DQ  analysis  perform  so  poorly?  The  problem  appears  to  be 
that  the  DQ  analysis  rules  match  on  the  syntax  of  the  system’s  differential 
equation  model.  For  example,  one  common  rule  applies  when  a  parameter’s 
derivative  is  a  linear  function  of  the  parameter.  Since  the  rule  only  has  access 
to  the  model’s  syntactic  description,  it  might  fire  if  the  model  unified  with 


m 


%•  *"w  %' 

v-Vv 

5c 


n 


m 


m 
0® 


the  patterns  (d/DT^Tx  ?v)  and  (MULT  ?x  ?k  ?v).  But  what  if  the  model 
was  more  indirect  and  included  the  two  equations  V  —  KU  and  U  —  A' A' 
instead  of  V  =  KXl  If  K  was  a  positive  constant,  the  two  formulations 
would  be  equivalent,  but  the  system  would  not  know  it.  Since  there  are  an 
infinite  number  of  ways  to  write  equivalent  models,  a  finite  set  of  rules  cannot 
recognize  them  all  without  help.  If  all  models  were  expressed  as  sets  of  first 
order  linear  equations,  then  it  might  be  possible  for  an  algebraic  manipula¬ 
tor  to  translate  them  into  canonical  form.  But  since  nonlinear  models  are 
allowed  and  can  contain  arbitrary  monotonic  function  constraints,  this  is  not 
obviously  feasible. 

Exaggeration  is  less  sensitive  to  model  differences  since  it  does  not  try  to 
differentiate  the  equations,  only  evaluate  them.  For  the  sets  of  differential 
equations  that  are  used  to  model  physical  systems  evaluation  means  quali¬ 
tative  simulation;  the  result  is  a  time  behavior  that  satisfies  the  differential 
equation.  When  two  sets  of  differential  equations  evaluate  (simulate)  to  the 
same  values  (time  behaviors),  exaggeration  considers  them  equivalent.  Thus 
exaggeration  reaches  answers  more  frequently  because  simulating  a  differen¬ 
tial  equation  model  is  easier  than  directly  computing  the  partial  derivatives 
of  its  solution. 

The  following  example  demonstrates  a  different  form  of  brittleness  in  DQ 
analysis  which  is  also  caused  by  a  lack  of  algebraic  reasoning.  Imagine  two 
containers,  each  initially  filled  to  the  same  level  with  liquid.  Suppose  that 
a  pump  moves  liquid  from  container  B  to  A,  but  that  the  wall  between 
the  containers  is  permiable.  If  there  is  a  pressure  gradient  from  A  to  B, 
then  liquid  will  seep  backwards.  The  system  can  be  modeled  with  seven 
parameters,  the  fluid  level  in  the  containers  La  and  Lb,  the  difference  in 
height1  H,  the  rate  of  pumped  and  seeping  flow  Fp  and  F,,  net  flow  F„ 
and  the  permiability  of  the  wall  separating  the  containers  P,  obeying  the 
following  constraints: 


Lb  =  minus(  La ) 

(4.1) 

La  =  ADD  {Lb,  H) 

(4.2) 

F,  =  mult(  H,  P)Fn  =  ADD  (Fp,  F,) 

(4.3) 

Fn  =  i-tLa 

(4.4) 

‘Height  difference  is  also  used  to  represent  difference  in  pressure. 


Figure  4.3:  Equilibrium  State  for  Pumped  Containers 

Given  this  model,  QSIM  quickly  determines  that  the  height  difference 
between  the  two  containers  will  rise  until  an  equilibrium  value  is  reached 
in  which  there  is  no  net  flow  (figure  4.3).  Both  DQ  analysis  and  exaggera¬ 
tion  correctly  solve  the  comparative  analysis  question  “What  happens  to  the 
height  difference  if  the  rate  of  pumped  flow  is  greater?”  DQ  analysis  uses 
the  following  line  of  reasoning: 

Since  there  is  a  greater  pumped  flow,  the  rate  of  seepage  must 
be  greater  at  equilibrium.  This  means  that  the  height  (pressure) 
difference  must  be  greater. 

This  explanation  is  simple  and  to  the  point.  Unfortunately,  DQ  analysis 
(unlike  exaggeration)  does  not  realize  that  La  is  higher  at  equilibrium  even 
though  this  is  a  simple  algebraic  consequence  of  a  greater  height.  This  inad¬ 
equacy  would  not  be  solved  by  preprocessing  the  differential  equation  model 
into  canonical  form.  Postprocessing  the  output  of  DQ  analysis,  however, 
might  increase  coverage.  This  is  an  interesting  avenue  for  future  research. 

As  explained  in  the  section  above,  different  types  of  ambiguity  are  the 
cause  for  the  incompleteness  of  DQ  analysis.  Yet  DQ  analysis  handles  am¬ 
biguity  differently  from  other  forms  of  qualitative  reasoning.  For  example, 
when  QSIM  is  faced  with  ambiguity  about  a  parameter’s  value,  it  branches, 
spawning  perhaps  three  new  behaviors:  one  with  the  parameter  equal  to  a 
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landmark  value,  one  greater  and  one  less.  QSIM  can  do  this  because  the 
nature  of  inequality  guarantees  that  either  A  <  B,  A  —  B,  or  A  B.  While 
this  is  true  for  RC  values  at  transition  points,  it  is  not  true  for  RC  values 
over  intervals. 

Proposition  21  Non-Exhaustivity 

Given  two  parameters,  V  and  P,  such  that  P  is  a  covering  perspective  over  an 
interval  (7i,7i+i)>  *’<  ls  not  necessarily  the  case  that  one  of  U||£tIf  1(, 

«'  VIjJU.I  holds. 

Proof:  Appendix  B  provides  an  example  which  proves  this  statement  D 
Thus  unlike  qualitative  simulators,  DQ  analysis  can  not  branch  when 
faced  with  uncertainty,  it  simply  acts  mute. 

4.4  Performance  Difference 

This  section  considers  the  worst  case  computational  complexity  of  the  two 
comparative  analysis  techniques.  The  quick  answer  is  that  DQ  analysis  is 
considerably  more  efficient  than  exaggeration:  polynomial  rather  than  expo¬ 
nential  in  the  length  of  simulation  time. 

4.4.1  DQ  Analysis  is  Polynomial 

Since  DQ  analysis  is  implemented  as  a  forward  chaining  rule  system  based  on 
a  propositional  database,  two  kinds  of  operations  are  suggested  as  possible 
computational  metrics:  the  number  of  database  matches  and  the  number 
of  actual  rule  firings.  There  are  two  reasons  why  the  number  of  database 
matches  is  the  best  metric.  Since  no  rule  can  fire  before  being  matched  to 
the  database,  the  number  of  matches  is  a  more  conservative  metric  and  thus 
more  appropriate  as  a  worst  case  measurement.  Secondly,  informal  metering 
of  the  ARK  substrate  indicates  that  the  vast  majority  of  compute  time  is 
actually  spent  performing  the  matches. 

Unlike  many  forward  chaining  systems,  one  can  show  that  DQ  analysis 
has  a  tight  bound  on  the  number  of  entries  that  can  be  stored  in  the  database. 
This  in  turn  limits  the  number  of  matches  that  can  be  performed  before  the 
rule  system  reaches  quiescence. 


Each  database  entry  is  one  of  a  constant  number  of  types.  The  ‘relative 
change  over  an  interval’  type  is  the  most  important  from  the  perspective  of 
this  analysis  because  it  has  the  greatest  number  of  independent  slots  and  thus 
spawns  the  greatest  potential  number  of  entries.  Since  this  type’s  pattern  is 
instantiated  by  two  parameter  slots  (one  for  the  parameter  being  compared 
and  one  for  the  perspective)  and  one  time  slot,  there  are  @(TP2)  entries  in 
the  database  where  P  is  the  number  of  parameters  in  the  system  and  T  is 
the  temporal  length  of  the  behavior. 

Every  time  that  a  new  entry  is  made  to  the  database,  it  is  matched  against 
every  rule  to  see  if  it  enables  one  to  fire.  Assuming  R  rules  and  E  entries, 
the  number  of  matches  is  greater  than  Q(RE)  because  some  entries  can  be 
matched  against  some  rules  in  more  than  one  way.  For  example,  it  is  very 
common  for  the  conjunctive  antecedent  of  a  rule  to  contain  two  patterns  of 
the  same  type,  as  shown  here. 

(=>  (AND  (RC  ?v  (?start  ?middle)  ?c  (P-  ?x)) 

(RC  ?v  (?middle  ?end)  ?c  (P-  ?x))) 

(RC  ?v  (?start  ?end)  ?c  (P-  ?x)) 
stupid-rule) 

If  there  were  E  database  entries  with  this  ‘relative  change  over  an  interval’ 
type,  then  this  rule  might  be  satisfied  Q(E2)  ways.  Since  the  set  of  rules  is 
fixed,  there  exists  a  finite  bound,  a,  on  the  maximum  number  of  conjuncts  in 
a  rule  antecedent.2  Thus  the  total  number  of  database  matches  is  Q(REa) 
or  equivalently  Q(RTaP2a). 

Although  this  is  a  worst  case  analysis,  the  average  case  complexity  is 
probably  similar.  For  systems  of  seven  parameters,  with  behaviors  that  con¬ 
tain  ten  time  points  or  intervals,  running  in  the  current  base  of  eighty  rules, 
it  takes  about  three  minutes  to  reach  quiescence. 

4.4.2  Exaggeration  is  Exponential 

Let  P  denote  the  number  of  parameters  in  the  system,  let  C  be  the  num¬ 
ber  of  constraints,  and  T  the  length  of  time  before  the  event  of  interest. 
The  transform  phase  is  fast,  Q(P)  since  the  most  expensive  operation  is  the 
reformulation  of  each  parameter’s  quantity  space. 


2For  the  current  rule  set  as:  6. 


As  a  first  step  in  the  complexity  analysis  of  the  simulate  phase,  consider 
the  time  required  for  HR-QSIM  to  generate  the  successors  of  a  qualitative 
state.  The  analysis  is  very  similar  to  that  of  QSIM  [27,  page  312],  Transition 
tables  generate  possible  values  in  0(P)  time.  The  most  expensive  constraint 
filter  is  the  check  of  corresponding  values  which  grow  over  time  resulting  in 
a  complexity  of  Q(PT)  time.  Waltz  filtering  requires  O(C')  time.  Unfortu¬ 
nately,  when  the  parameter  values  are  combined  into  global  interpretations, 
0(2P)  interpretations  are  possible  in  the  worst  case.  In  practice,  the  number 
of  interpretations  is  much  smaller,  between  three  and  one,  decreasing  as  the 
number  of  constraints  rises.  Predecessor-persistence  and  successor- arrival 
filtering  require  0(P)  time  for  each  interpretation. 

Thus,  on  average  HR-QSIM,  like  QSIM  before  it,  produces  each  successor 
state  in  linear  time.  While  it  is  possible  to  construct  pathological  cases  where 
each  state  has  an  exponential  number  of  successors,  these  seem  quite  rare. 
Even  with  the  common  case  of  bounded  branching,  however,  the  situation 
is  far  from  rosy.  Since  HR-QSIM  generates  a  tree  of  states  in  breadth  first 
fashion,  the  number  of  states  produced  is  exponential  in  T,  the  maximum 
time  considered.  In  fact,  the  situation  is  effectively  worse  for  HR-QSIM  than 
it  is  for  QSIM.  Because  parameters  pass  through  infinitesimal  halos  on  their 
way  from  a  landmark  to  a  finite  interval,  more  qualitative  states  are  needed 
to  represent  the  ‘same’  behavior.  This  means  that  T  is  almost  twice  as  large 
for  a  HR-QSIM  behavior  as  for  an  analogous  QSIM  behavior. 

The  scale  phase  is  also  exponential  in  T  because  it  needs  to  compare  each 
behavior  against  the  original  QSIM  behavior.  The  number  of  HR-QSIM  be¬ 
haviors  is  equal  to  the  number  of  leaves  on  the  state  tree  which  is  exponential 
in  the  depth,  71,  of  the  tree.  In  practice,  the  constant  factor  is  so  much  lower 
for  the  scale  phase  than  the  simulate  phase,  that  its  speed  is  not  an  issue. 

The  preceding  analysis  is  worst  case.  For  many  problems,  HR-QSIM  pro¬ 
duces  a  single  unbranching  behavior.  Out  of  the  more  than  fifty  compara¬ 
tive  analysis  problems  attempted,  only  three  had  truly  intractable  branching 
(appendix  F).  With  these  problems  additional  heuristics  or  manual  search 
control  would  have  been  necessary  for  exaggeration  to  reach  an  answer. 
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4.5  Explanation  Difference 

A  final  question  applies  to  those  comparative  analysis  problems  that  are 
answered  by  both  techniques.  Which  of  the  resulting  explanations  is  better? 
Since  comparative  analysis  is  distinguished  from  sensitivity  analysis  by  its 
ability  to  generate  explanations,  this  is  an  important  question  to  answer. 
Unfortunately,  the  multitude  of  factors  affecting  the  perceived  quality  of  an 
explanation  make  this  difficult  question  as  well.  I  start  by  addressing  criteria 
for  a  good  explanation. 

4.5.1  What  Makes  a  Good  Explanation? 

While  psychological  studies  are  probably  the  best  way  to  measure  the  quality 
of  explanations,  such  studies  are  beyond  the  scope  of  this  thesis.  Instead,  I 
present  abstract  desiderata  that  explanations  should  meet.  One  factor  not 
included  is  the  quality  of  the  natural  language  text,  since  I  am  concerned  with 
the  nature  of  the  underlying  argument,  not  the  way  in  which  that  argument 
is  presented.  In  fact,  DQ  analysis  has  only  a  rudimentary  algorithm  for 
transforming  proof  trees  into  English  text,  while  no  such  algorithm  has  been 
implemented  for  exaggeration.  It  goes  without  saying  that  any  argument  is 
improved  by  good  diction,  but  the  issues  involved  are  unrelated  to  those  of 
this  thesis. 

•  The  most  obvious  criterion  is  that  the  explanation  should  answer  the 
question  and  do  so  correctly.  Section  4.3  showed  that  DQ  analysis 
meets  this  requirement,  but  exaggeration  does  not. 

•  The  explanation  should  be  grounded  in  information  already  known  by 
the  listener.  Unless  this  criterion  is  met,  the  listener  cannot  graft  the 
explanation  into  his  previous  understanding  and  will  remain  confused. 
Both  DQ  analysis  and  exaggeration  meet  this  requirement  by  only  us¬ 
ing  information  that  is  made  explicit  in  the  problem  specification.  Note 
that  I  have  not  addressed  the  major  question  of  student  modeling.  The 
problem  of  gauging  what  a  person  knows  and  choosing  an  understand¬ 
able  and  appropriate  model  is  a  topic  for  future  research. 

•  The  explanation  should  not  contain  extraneous  information  that  might 
confuse  or  distract  the  listener.  DQ  analysis  certainly  satisfies  this 


requirement — the  constraint  propagator  maintains  a  dependency  struc¬ 
ture  showing  which  rules  led  to  any  conclusion  and  exactly  what  facts 
were  involved.  A  differential  qualitative  explanation  is  simply  a  refor¬ 
matted  version  of  the  dependency  tree. 

At  one  level  exaggerated  explanations  meet  this  requirement,  but  at 
another  level  the  current  implementation  is  deficient.  The  distinction 
is  one  of  detail  in  the  explanation.  If  one  assumes  that  the  explanation 
does  not  need  to  explain  why  the  exaggerated  system  has  the  behavior 
predicted  by  HR-QSIM,  then  no  irrelevant  facts  are  introduced.  The 
conclusion  follows  directly  from  an  observation  of  a  difference  in  the 
standard  and  hyperreal  behaviors.  However,  if  one  assumes  that  the 
explanation  should  justify  the  hyperreal  behavior,  then  irrelevancies 
occur.  The  problem  is  the  fundamental  way  that  QSIM  is  structured. 
Rather  than  deducing  causal  connections  between  parametric  values, 
QSIM  (and  HR-QSIM)  generate  the  space  of  all  possible  behaviors  and 
then  discard  the  inconsistent  ones.  Although  the  strategy  results  in  an 
elegant  and  (on  average)  speedy  algorithm,  there  is  no  way  to  justify  a 
behavior  other  than  to  say  that  the  alternatives  were  inconsistent.  As 
a  result  there  is  no  way  to  isolate  the  facts  that  underlie  a  parameter’s 
hyperreal  value.  Fortunately,  this  limitation  is  not  basic  to  the  idea  of 
exaggeration,  only  to  this  implementation  of  the  simulate  phase.  If  any 
of  the  other  qualitative  simulators  [16,8,49]  had  been  used  as  a  basis 
for  the  simulate  phase,  this  problem  would  not  apply. 

■  explanation  should  not  require  mathematical  sophistication.  While 
lathematical  arguments  will  quickly  convince  those  who  appreciate 
ihem  people  unfamiliar  with  mathematical  concepts  and  notation  will 
likely  get  lost.  Both  DQ  analysis  and  exaggeration  produce  explana¬ 
tions  that  meet  this  goal. 

•  The  explanation  should  be  short.  Long  and  complicated  arguments 
are  by  definition  more  difficult  to  understand.  The  problem  is  to  be 
precise  about  measuring  the  length  of  an  explanation.  The  next  section 
argues  that  for  a  class  of  comparative  analysis  problems,  exaggeration 
generates  explanations  that  are  simpler  than  those  produced  by  DQ 
analysis. 


•  The  explanation  should  say  familiar  things  in  familiar  ways.  If  obvious 
points  are  couched  in  unfamiliar  terms,  then  recognition  and  compre¬ 
hension  take  longer.  Section  4.5.3  explains  why  both  DQ  analysis  and 
exaggeration  sometimes  generate  unnatural  explanations. 

It  is  interesting  to  note  that  the  popular  learning  technique,  explanation 
based  generalization  (EBG)  [29,13],  uses  the  word  ‘explanation'  in  the  same 
sense  that  I  do.  The  fact  that  EBG  requires  the  first  three  of  my  criteria  to 
generalize  successfully  lends  extra  weight  to  the  desiderata.  To  support  this 
argument  I  implemented  an  EBG  algorithm  [24]  that  correctly  generalizes 
the  explanations  produced  by  DQ  analysis  (section  2.3). 

4.5.2  Exaggeration  can  Produce  Simpler  Answers 

In  some  cases  DQ  analysis  and  exaggeration  produce  similar  explanations, 
but  there  are  also  cases  when  the  explanations  are  very  different.  The  oscil¬ 
lating  spring  /  block  is  an  example  of  a  system  on  which  the  two  perform 
similarly.  Given  a  question  about  the  relative  change  of  period  caused  by  an 
increase  in  mass,  DQ  analysis  deduces  that  force  is  the  same,  so  acceleration 
is  smaller,  so  velocity  is  smaller,  so  the  time  is  longer.  Exaggeration  needs 
a  similar  line  of  reasoning  to  justify  the  fact  that  a  block  with  infinite  mass 
has  infinite  period:  force  is  finite,  so  acceleration  is  infinitesimal,  so  velocity 
is  infinitesimal,  and  so  on. 

More  interesting  are  the  explanations  that  are  not  parallel.  A  good  ex¬ 
ample  is  the  question  “What  happens  to  output  temperature  when  hot  oil 
passes  more  quickly  through  a  heat  exchanger?”  A  DQ  explanation  needs 
to  follow  through  the  details  of  the  constraint  model  of  heat  flow,  but  an 
exaggerated  explanation  can  disregard  the  details  of  heat  flow  because  it  has 
negligible  effect  when  the  oil  moves  infinitely  fast.  Consider  the  following 
possible  heat  exchangers  (not  all  implemented): 

•  Hot  oil  flows  through  a  bath  of  coolant  held  at  constant  temperature. 

•  Hot  oil  flows  through  a  bath  of  coolant  that  gradually  warms. 

•  Hot  oil  flows  down  a  pipe  in  one  direction  while  warming  coolant  flows 
through  a  concentric  pipe  in  the  other  direction. 


•  Hot  oil  and  coolant  flow  in  same  direction  through  concentric  pipes. 


•  Any  of  the  above  models  with  thermal  conductivity  changing  as  a  func¬ 
tion  of  temperature  difference. 

•  Any  of  the  above  models  complicated  by  modeling  the  thermal  mass  of 
the  pipe  wall.  This  causes  two  heat  flows:  from  the  oil  to  the  pipe  wall 
then  from  the  wall  to  the  coolant. 

In  fact  DQ  analysis  can  only  answer  the  comparative  analysis  question  on 
the  first  (and  simplest)  heat  exchanger  model,  but  if  it  could  reason  about  the 
others  its  answers  would  get  more  and  more  complicated.  The  exaggerated 
answer,  on  the  other  hand,  could  remain  the  same  for  each  of  these  models. 
The  details  of  the  heat  flow  process  are  irrelevant  since  the  flow  rate  is  only 
finite  and  the  oil  is  moving  infinitely  fast.  In  these  cases  the  exaggerated 
explanation  is  simpler  because  it  abstracts  irrelevant  detail  from  the  heat 
flow  process. 

Although  the  answer  is  simpler,  the  simulate  phase  of  exaggeration  makes 
no  simplifying  assumptions  and  in  fact  performs  more  work  on  the  more 
complex  models.  Getting  computer  problem  solvers  to  autonomously  refine 
their  models  with  simplifying  assumptions  is  an  important  subject  for  future 
research. 


4.5.3  Unnatural  Explanations 

Both  DQ  analysis  and  exaggeration  sometimes  generate  correct,  yet  unnatu¬ 
ral  explanations.  The  underlying  cause  of  the  awkwardness  is  the  expression 
of  a  familiar  idea  in  an  unfamiliar  way. 

For  example  take  the  question  “What  happens  to  the  output  temperature 
of  the  hot  oil  if  it  moves  more  rapidly  through  the  heat  exchanger?”  Since 
the  oil  is  cooling  as  it  moves  through  the  exchanger,  one  would  like  the 
answer  expressed  “The  oil  will  cool  less”  rather  than  “It  will  exit  hotter.” 
Unfortunately,  neither  DQ  analysis  nor  exaggeration  makes  commitment  to 
a  strong  process  ontology  [16]  that  would  facilitate  this  distinction. 

A  second  example  of  a  correct  yet  cognitively  dissonant  explanation  con¬ 
cerns  the  use  of  perspectives  in  DQ  analysis.  Many  times  a  problem  can 
be  solved  using  one  of  several  perspectives  and  to  the  program  they  all  look 


alike.  As  a  result,  the  explanation  might  be  parameterized  in  terms  of,  say, 
force  rather  than  position.  Although  the  argument  would  be  right,  it  would 
be  unfamiliar.  The  problem  is  not  new  [6],  but  it  won’t  go  away  without 
careful  heuristics  explaining  common  ways  of  viewing  the  world. 

A  third  example  of  awkwardness  applies  only  to  exaggeration.  The  idea 
behind  exaggeration  is  to  transform  a  small  perturbation  into  a  change  that 
is  large  enough  to  make  the  overall  influence  obvious.  In  this  thesis,  I  discuss 
transformations  to  infinite  and  infinitesimal  values  because  these  values  have 
qualitatively  different  behavior  that  can  be  deduced  abstractly.  Since  people 
live  in  the  world  and  remember  past  observations,  they  don’t  always  need  to 
use  such  extreme  examples.  Often  they  can  simply  remember  an  exaggerated 
system  that  is  adequate  for  the  scale  phase  without  performing  simulation. 
In  other  words  a  perfectly  valid  (and  natural)  exaggerated  explanation  of  the 
increased  mass  oscillator  example  might  be: 

What  happens  to  the  period  of  oscillation  if  you  increase  the 
mass  of  the  block?  Well,  Uncle  Fred  had  an  oscillator  like  this 
with  a  wicked  big  mass  and  it  sure  did  have  a  long  period.  Thus, 

I  bet  an  increase  in  mass  increases  period. 

A  related  example  emphasizes  this  problem.  Imagine  a  projectile  fired 
upwards  at  some  velocity.  What  happens  to  the  projectile’s  flight  time  if 
initial  velocity  is  decreased?  Exaggeration  solves  this  problem  correctly  with 
the  following  argument: 

If  the  initial  velocity  was  negligible,  then  the  projectile  would 
stop  climbing  after  a  negligible  time  since  gravity  causes  a  finite 
deceleration.  In  this  time,  the  projectile  would  have  climbed  only 
a  negligible  distance,  so  the  fall  time  will  also  be  negligible.  Thus 
a  negligible  velocity  results  in  negligible  flight  time  so  decreasing 
velocity  decreases  flight  time. 

While  this  explanation  is  correct,  it  is  rather  unnatural.  A  much  simpler 
explanation  is  the  following: 

If  the  initial  velocity  was  zero,  the  projectile  wouldn’t  go  any¬ 
where.  In  other  words,  the  flight  time  would  be  zero.  Thus 
decreasing  initial  velocity  decreases  flight  time. 


The  current  theory  of  exaggeration  specifies  transforming  to  a  positive 
infinitesimal  rather  than  zero  because  it  is  safer.  Many  systems  become  dis¬ 
continuous  when  a  parameter  goes  to  zero  and  this  give  unreliable  answers.3 
In  this  example,  a  transform  value  of  zero  is  safe  and  actually  preferable  to 
the  value  of  negl.  However,  the  general  problem  of  determining  the  most 
natural  explanation  is  a  difficult  one. 

4.0  Combining  the  Techniques 

Since  the  strengths  of  DQ  analysis  and  exaggeration  are  complementary,  it 
is  natural  to  consider  combining  them.  The  advantage  of  DQ  analysis  is 
the  guarantee  that  when  it  answers  a  question,  the  explanation  is  correct. 
Exaggeration,  on  the  other  hand,  can  generate  incorrect  answers  for  systems 
in  which  the  perturbation  causes  nonmonotonic  changes  in  parameter  values. 
There  appears  to  be  no  general,  qualitative  method  of  ensuring  that  a  system 
reacts  monotonically. 

On  the  other  hand,  exaggeration  appears  to  solve  many  more  compara¬ 
tive  analysis  problems  than  does  DQ  analysis.  Both  techniques  solve  some 
problems  that  stump  the  other,  but  exaggeration  has  the  upper  hand.  By 
combining  the  techniques,  one  could  create  a  high  level  architecture  more  ef¬ 
fective  than  either  technique  alone.  A  comparative  analysis  problem  should 
first  be  subjected  to  DQ  analysis.  If  that  works,  then  a  sound  answer  is 
guaranteed.  If  DQ  analysis  fails,  then  apply  exaggeration.  Now  check  exag¬ 
geration’s  predictions  with  all  of  the  relative  change  values  that  DQ  analysis 
is  able  to  deduce.  If  they  all  agree,  the  chances  are  good  that  nonmonotonic 
behavior  is  absent.  Finally,  exaggerate  the  perturbation  in  the  opposite  di¬ 
rection  and  check  that  the  resulting  predictions  are  the  opposite  of  the  first 
transformation.  Although  there  will  still  be  pathological  cases,  these  precau¬ 
tions  would  maximize  the  heuristic  power  of  the  exaggeration  method. 


3For  example,  try  exaggerating  the  spring  constant  to  zero  in  the  oscillating  spring  / 
block  example,  or  oil  velocity  to  zero  in  the  heat  exchanger  system. 


Chapter  5 
Related  Work 


Despite  its  importance,  little  previous  attention  has  been  devoted  to  the 
questions  of  comparative  analysis  by  artificial  intelligence  researchers.  This 
chapter  starts  by  discussing  the  related  engineering  field  of  sensitivity  analy¬ 
sis,  and  then  proceeds  to  summarize  previous  AI  research  of  interest.  Alter¬ 
nate  temporal  representations  are  mentioned  first  because  they  are  relevant 
to  both  the  DQ  and  exaggeration  approaches.  Next,  de  Kleer’s  work  on  IQ 
analysis  and  Forbus’  approach  to  DQ  analysis  are  presented.  The  chapter 
next  considers  AI  work  related  to  exaggeration:  Raiman’s  FOG,  Kuiper’s 
time  scale  abstraction,  and  Davis’  order  of  magnitude  solution  of  qualitative 
differential  equations. 


5.1  Sensitivity  Analysis 

Sensitivity  analysis  is  a  common  engineering  technique  for  calculating  the 
effect  on  system  performance  due  to  variations  in  system  parameters.  Com¬ 
parative  analysis  is  a  qualitative  version  of  sensitivity  analysis.  The  sensitiv¬ 
ity  of  a  quantity  Y  to  perturbations  in  a  parameter  X  is  defined  [1]  as  the 
product: 

dY  X 
dX  Y 

Because  of  its  important  application  to  design,  considerable  work  has  been 
done  on  efficient  methods  for  calculating  sensitivities.  Approaches  include 
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numerical  and  symbolic  differentiation,  construction  of  an  incremental  net¬ 
work,  and  analysis  of  an  adjoint  network  [lj. 

Compared  to  either  DQ  analysis  or  exaggeration,  these  methods  have 
a  major  advantage — they  generate  a  quantitative  value  for  sensitivity.  But 
sensitivity  analysis  has  two  limitations.  Sensitivity  analysis  requires  an  ex¬ 
plicit  equation  for  all  quantities  of  interest.  Thus  sensitivity  analysis  could 
not  answer  the  spring  /  block  problem  until  it  was  provided  with  a  formula 
for  period  of  oscillation.  For  linear  systems  like  the  spring  /  block,  these 
equations  could  be  derived  automatically.  For  nonlinear  systems,  no  general 
soultion  technique  exists.  One  could  introduce  piecewise  linear  approxima¬ 
tions  as  suggested  by  Sacks  ??,  but  there  is  no  way  to  ensure  that  the  reulting 
equations  are  valid. 

A  more  important  limitation  of  sensitivity  analysis,  however,  is  the  fact 
that  it  does  not  generate  an  explanation;  all  it  provides  is  the  answer.  For 
many  purposes  this  is  acceptable,  but  not  for  comparative  analysis. 

The  technique  of  comparative  statics  [38,23],  long  used  in  economics  to 
compare  two  different  equilibrium  behaviors,  suffers  from  the  same  limitation. 
It  requires  an  explicit  formula  for  the  partial  derivative  in  question. 

5.2  Williams’  Temporal  Representation 

QSIM  [27]  is  a  simple,  easy  to  use  simulator  that  has  significantly  sped  the 
implementation  of  both  exaggeration  and  DQ  analysis.  However,  QSIM  has 
defects;  its  weak  temporal  representation  is  a  major  problem  that  affects  my 
comparative  analysis  techniques. 

As  explained  by  Hayes  in  [21],  systems  that  represent  behaviors  as  a  se¬ 
quence  of  states  force  a  total  ordering  on  transitions.  Because  qualitative 
reasoning  is  often  unable  to  determine  an  unambiguous  order  of  transitions, 
the  behavior  must  branch  to  consider  multiple  possibilities.  If  events  interact, 
the  various  branches  often  have  interesting  qualitative  differences.  But  fre¬ 
quently,  the  alternate  behaviors  are  equivalent  and  just  complicate  reasoning 
and  consume  processing  resources. 

To  combat  this  problem,  Williams  introduced  the  notion  of  concise  episodes 
[45],  and  has  devised  an  efficient  simulator  (called  a  Temporal  Constraint 
Propagator)  to  manipulate  them.  Just  as  standard  qualitative  simulators 
using  Williams’  temporal  representation  would  improve  on  QSIM,  exagger- 


ation’s  simulate  phase  would  produce  fewer  extraneous  behaviors  if  it  used 
the  representation.  Although  this  would  not  increase  the  competence  of  the 
overall  exaggeration  algorithm,  it  would  simplify  interpretation  performed 
by  the  scale  phase  and  might  increase  overall  speed.  The  underlying  tech¬ 
niques  of  predecessor-persistence  and  successor-arrival  filtering  would  still  be 
applicable. 

Similarly,  a  DQ  analysis  implementation  that  used  Williams’  concise 
episode  representation  would  have  several  advantages  over  CA.  Williams  is 
building  such  a  system  for  use  in  automated  design  [48]. 

•  The  propositions  of  section  2.2  would  still  be  true,  and  could  be  en¬ 
coded  more  easily.  CA  requires  explicit  rules  for  composing  dura¬ 
tions  over  intervals  (e.g.,  if  DURATION^  j)  and  DURATIONf^j  2j  then 
DURATIONf!(0  2)).  These  computationally  expensive  rules  would  be  sub¬ 
sumed  by  the  temporal  constraint  propagator. 

•  The  search  for  topologically  distinct  behaviors  (section  2.5)  would  be 
simplified  because  the  space  would  be  smaller.  By  eliminating  irrel¬ 
evant  order  distinctions,  the  number  of  different  behaviors  would  be 
smaller.  Only  if  it  was  qualitatively  interesting  would  there  be  any 
need  to  consider  a  behavior  in  which  two  parameters  reach  transitions 
simultaneously. 

5.3  de  Kleer’s  IQ  Analysis 

de  Kleer’s  theory  of  Incremental  Qualitative  (IQ)  analysis  [6]  is  the  prede¬ 
cessor  of  DQ  analysis  and  marks  the  start  of  artificial  intelligence  work  in 
comparative  analysis.  The  overall  goal  de  Kleer  was  trying  so  solve  was  the 
recognition  and  explanation  of  electronic  circuit  function  given  a  schematic. 
The  resulting  program,  QUAL,  worked  in  two  phases.  First,  the  circuit  was 
simulated  to  determine  its  qualitative  behavior.  Then  the  behavior  is  parsed 
using  a  grammar  for  common  circuit  functions.  QUAL  works  successfully  on 
hundreds  of  examples. 

de  Kleer  calls  QUAL’s  first  phase  causal  analysis: 

Causal  analysis  takes  a  description  of  the  circuit’s  topology 
as  an  input  and  produces  a  qualitative  description  of  the  circuits 
incremental  behavior  as  an  output  ([6,  page  20]). 


Causal  analysis  is  halfway  between  the  notion  of  qualitative  simulation  and 
that  of  comparative  analysis.  The  interesting  behavior  of  the  circuits  that  de 
Kleer  investigated  is  not  at  steady  state,  rather  it  is  the  perturbations  from 
equilibrium  that  are  interesting: 

Causal  analysis  produces  a  causal  argument  which  is  a  qualita¬ 
tive  description  of  how  the  circuit  equilibrates  —  how  it  responds 
to  perturbations  from  it  equilibrium  state  ([6,  page  50]). 

Causal  analysis  is  implemented  with  a  technique  called  IQ  analysis.  IQ 
analysis  uses  the  same  ft  U  notation  of  DQ  analysis,  but  these  values  refer  to 
the  values  of  parameter  derivatives,  not  to  the  difference  between  parameter 
values  in  alternate  worlds.  In  other  words,  IQ  analysis  is  concerned  with 
the  evolution  of  a  single  behavior  considered  as  a  pattern  of  perturbations  to 
steady  state  values,  rather  than  the  comparison  of  two  alternate  behaviors. 
As  a  result,  IQ  analysis  has  no  explicit  notion  of  time.  When  the  IQ  valuejor 
a  parameter  changes,  its  old  value  is  lost.  This  means  that  IQ  analysis  cannot 
answer  questions  that  would  be  easy  for  DQ  analysis.  For  example,  “If  the 
perturbation  to  V  was  greater,  would  it  take  longer  to  reach  equilibrium?” 

IQ  analysis  is  thus  designed  to  solve  a  specific  class  of  simulation  problems 
rather  than  answer  comparative  analysis  questions.  However,  IQ  analysis  in¬ 
spired  Forbus  to  consider  DQ  analysis,  the  first  work  on  comparative  analysis 
per  se. 

5.4  Forbus’  DQ  Analysis 

In  his  work  on  Qualitative  Process  (QP)  theory,  Forbus  introduced  differen¬ 
tial  qualitative  analysis  [16,  pages  159-161]  and  contrasted  it  with  de  Kleer’s 
IQ  analysis.  However,  Forbus  attempted  no  implementation  and  his  formal¬ 
ization  has  serious  problems.  Forbus  defined  a  quantity  Qx  to  be  greater  than 
Q2  over  an  interval,  J,  if  for  all  instants  in  the  interval,  Q j  >  Q2  measured 
at  that  instant.  Unfortunately,  this  definition  has  several  problems.  Since 
the  quantification  is  over  a  single  interval  of  time,  it  is  impossible  to  make 
comparisons  of  systems  whose  time  behavior  changes  as  a  result  of  a  pertur¬ 
bation.  Thus  his  attempt  to  formalize  “distance  equals  rate  times  duration” 
in  predicate  calculus  is  severely  limited.  Rates  can  only  be  compared  if  the 
duration  of  an  interval  is  unchanged. 


But  even  if  the  quantification  was  correct,  time- wise  comparison  is  almost 
never  a  useful  one  to  make.  In  the  spring/block  case,  for  example,  it  simply 
isn’t  the  case  that  the  heavy-block  is  always  moving  slower  than  the  small- 
block;  the  periods  get  out  of  phase.  The  key  to  solving  these  problems  is  in  the 
use  of  perspectives  discussed  earlier.  The  comparison  on  velocity  (necessary 
to  predict  that  the  period  lengthens)  is  valid  only  from  the  perspective  of 
position. 

5.5  Raiman’s  FOG 

The  formal  basis  for  exaggeration  was  inspired  by  Raiman’s  FOG  system 
for  order  of  magnitude  reasoning  [32].  FOG  is  a  representation  that  reduces 
qualitative  reasoning  ambiguity  by  explicitly  modeling  the  fact  that  some 
parameters  are  negligible  compared  to  others.  Unlike  previous  attempts  at 
order  of  magnitude  reasoning,  Raiman’s  rules  are  based  on  nonstandard  anal¬ 
ysis  [33]  and  are,  therefore,  consistent.  On  the  surface  there  appears  to  be 
considerable  overlap  between  exaggeration  and  FOG,  but  in  fact  the  systems 
are  quite  different.  The  main  similarity  is  the  shared  foundation  of  nonstan¬ 
dard  analysis  and  the  hyperreal  numbers,  which  results  in  a  similar  model  of 
quantity  space. 

Although  FOG  does  not  represent  a  quantity  space  explicitly,  it  is  im¬ 
plicit  in  the  FOG  relations:  <C  (infinitely  less  than),  (infinitesimally  close 
to),  and  ~  (same  order  of  magnitude)1  These  relations  are  as  expressive 
as  exaggeration’s  qualitative  hyperreal  representation  with  disjunction.  For 
example,  one  can  write  A  €  (HALO  xo  4- )  as  X  %  xo  A  [A-]  =  +,  and 
X  €  -<0,xo>-  is  equivalent  to 

X  ~  x0  A  [X]  =  +  A  Y  =  X  +  x0  A  [Y]  =  -  A  -.V  %  0 

The  FOG  expression  X  %  0  translates  to: 

X  €  (halo  0  — )  V  A  =  0  V  Ae  (halo  0  +  ) 

Although  the  two  representations  are  equivalent,  one  may  be  considerably 
more  convenient  than  the  other  for  a  specific  task.  The  brevity  and  specificity 
of  the  qualitative  hyperreal  representation  is  a  big  advantage  for  simulation. 


But  FOG  is  just  an  algebraic  reasoner.  Since  it  doesn’t  know  about 
derivatives  and  integration,  it  cannot  do  qualitative  simulation  (as  is  required 
for  exaggeration’s  simulate  phase).  Within  the  scope  of  algebraic  reasoning, 
however,  FOG’s  performance  is  impressive.  Raiman  poses  the  qualitative 
physics  problem:  “If  two  masses,  one  much  smaller  than  the  other,  are  moving 
towards  each  other  with  similar  velocities,  what  will  their  velocities  be  after 
an  elastic  collision?”  He  demonstrates  that  approaches  based  on  standard 
qualitative  algebras  are  defeated  by  ambiguity.  In  contrast,  FOG  uses  the 
assumption  that  one  mass  is  negligible  compared  to  the  other  to  correctly 
predict  that  the  velocity  of  the  big  mass  will  be  relatively  unaffected  while 
the  small  mass  will  reverse  direction  and  retreat  at  three  times  its  original 
speed. 

While  this  appears  to  be  dynamical  reasoning,  it  is  not.  The  equations 
of  motion  for  an  elastic  collision  are  discontinuous  and  thus  cannot  be  dif¬ 
ferentiated.  Instead,  FOG  solves  the  problem  using  explicit  equations  for 
conservation  of  energy  and  momentum.  Extending  FOG  to  perform  qual¬ 
itative  simulation  would  be  a  major  task,  requiring  (among  other  things) 
analogs  of  the  predecessor- persistence  filter  and  the  successor  arrival  filler. 

5.6  Kuipers’  Time  Scale  Abstraction 

Time  scale  abstraction  [26]  is  a  technique  for  reducing  ambiguity  in  quali¬ 
tative  simulation  by  modeling  a  complex  system  as  a  hierarchy  of  smaller, 
interacting  equilibrium  mechanisms.  For  example,  Kuipers  describes  the  kid¬ 
ney’s  sodium  /  water  balance  mechanisms  in  terms  of  two  mechanisms  that 
operate  at  different  speeds.  The  water  balance  adjusts  volume  in  a  matter 
of  minutes  while  the  sodium  balance  adjusts  sodium  excretion  over  periods 
of  hours  and  days.  Kuipers  observes  that  the  amount  of  sodium  appears 
constant  to  the  water  balance  mechanism  but  the  water  mechanism  seems  to 
be  instantaneous  from  the  eyes  of  the  sodium  mechanism.  Thus: 

When  a  faster  mechanism  views  a  slower  one  as  being  con¬ 
stant,  the  slower  one  can  simply  be  treated  as  .  ource  of  values 
for  certain  parameters.  When  a  slower  mechanism  views  a  faster 
one  as  instantaneous,  a  relation  among  shared  variables  may  be 
treated  by  the  fast  mechanism  as  the  result  of  a  process  over  time, 


and  by  the  slow  mechanism  as  a  functional  relationship  ([26,  page 
622]). 

Kuipers  extended  QSIM  [27]  to  handle  mechanism  hierarchies  by  switch¬ 
ing  between  submodels,  starting  with  the  fastest  time  scale.  An  alternate  way 
to  simulate  this  hierarchical  model  would  be  to  use  HR-QSIM.  By  specifying 
sodium’s  derivative  as  negligible,  the  water  mechanism  would  be  guaran¬ 
teed  to  reach  equilibrium  first,  avoiding  the  intractable  branching  of  a  flat 
model.  But  I  propose  this  solely  to  demonstrate  the  relationship  between 
the  two  techniques.  Kuipers’  approach  has  the  advantage  that  the  time  scale 
abstraction  is  explicit,  not  buried  as  it  would  be  for  HR-QSIM. 

But  there  is  an  advantage  to  the  HR-QSIM  approach.  Kuipers  had  to 
carefully  hand  construct  his  model  hierarchy,  manually  assuring  consistency 
of  two  views  of  the  water  balance  mechanism:  the  fast  model  (a  QSIM  struc¬ 
tural  description)  and  the  slow  model  (a  single  constraint  in  the  sodium 
mechanism).  With  the  HR-QSIM  approach,  the  abstraction  assumption  can 
be  introduced  automatically.  For  example,  consider  a  flat  model  of  the  two 
mechanisms  combined  with  no  time  scale  information.  If  exaggeration  were 
given  the  comparative  analysis  question  “What  if  the  sodium’s  ‘velocity’  were 
less?”  then  it  would  automatically  generate  a  description  of  the  system  with 
the  time  scale  abstraction.  Unfortunately,  exaggeration’s  simulate  phase, 
HR-QSIM,  could  not  take  advantage  of  the  abstraction  since  it  is  not  ex¬ 
plicit.  The  case  is  similar  to  that  of  the  infinite  flow  rate  heat  exchanger 
discussed  in  section  4.5.2.  Unifying  the  modeling  abilities  of  exaggeration 
with  the  explicit  representation  of  Kuipers’  work  is  an  important  topic  for 
future  research. 

5.7  Davis’  CHEPACHET 

Intrigued  by  my  formulation  of  exaggeration  (personal  communication,  [42]), 
Ernie  Davis’  attacked  the  problem  of  order  of  magnitude  solution  of  qualita¬ 
tive  differential  equations  [3].  The  resulting  CHEPACHET  program  is  a  di¬ 
rect  analog  of  exaggeration’s  simulate  phase.  HR-QSIM  and  CHEPACHET 
are  very  similar.  In  fact  HR-QSIM’s  use  of  four  transition  tables  (section 
3.3.2)  follows  from  Davis’  temporal  topology  rule.  The  two  programs  appear 
to  be  equivalent  in  terms  of  systems  they  can  simulate  and  ambiguities  they 


filter.  However,  HR-QSIM  uses  a  more  expressive  qualitative  representation 
that  is  more  appropriate  for  exaggeration. 

5.7.1  Algorithm  Differences 

CHEPACHET  and  HR-QSIM  take  fundamentally  different  approaches  to 
solving  qualitative  differential  equations:  HR-QSIM  does  qualitative  simu¬ 
lation,  but  CHEPACHET  produces  an  envisionment.  HR-QSIM  assumes  a 
fixed  initial  state  and  produces  the  set  of  possible  behaviors  that  could  result 
from  that  initial  specification.  CHEPACHET,  on  the  other  hand,  generates 
the  graph  of  all  possible  states  and  the  transitions  between  them,  even  if  only 
a  small  subgraph  is  reachable  from  any  initial  state.  The  relative  merits  of 
the  two  approaches  have  been  widely  debated  in  the  literature  [17];  it  seems 
clear  that  both  have  advantages.  Envisionments  are  more  general,  but  also 
much  larger  and  thus  considerably  more  expensive  to  produce.  Given  the 
goal  of  exaggeration,  qualitative  simulation  is  the  appropriate  choice. 

Although  CHEPACHET  and  HR-QSIM  take  different  approaches  to  tem¬ 
poral  filtering,  the  approaches  appear  to  be  equivalent.  In  place  of  HR- 
QSIM’s  predecessor-persistence  and  successor-arrival  filtering,  CHEPACHET 
uses  several  inference  rules  based  on  the  notion  of  a  parameter’s  VARIANCE, 
how  much  the  parameter  is  allowed  to  change  during  a  time  interval.  The 
resulting  inference  rules  are  quite  elegant — very  simple  (e.g.,  no  need  for 
HR-QSIM’s  infinite  arrival  rule),  yet  powerful.  Both  HR-QSIM  and  CHEPA¬ 
CHET  characterize  a  state  in  terms  of  four  types  of  quantities.  Both  systems 
use  the  parameter’s  order  of  magnitude,  the  parameter’s  derivative  order  of 
magnitude,  and  the  parameter’s  persistence  time.2  In  addition,  HR-QSIM 
uses  the  parameter’s  arrival  time  while  CHEPACHET  uses  the  parameter’s 
variance.  The  one  drawback  to  using  variance  measures  rather  than  arrival 
times  as  this  fourth  quantity  is  its  lack  of  physical  significance.  This  com¬ 
plicates  the  process  of  understanding  the  reasons  for  CHEPACHET’s  predic¬ 
tions  —  an  important  liability  since  exaggeration  is  primarily  an  explanation 
technique. 

2Davis  calls  it  time  duration  or  'delta  T’  since  he  does  not  distinguish  between  persis¬ 
tence  and  arrival  times. 


5.7.2  Qualitative  Representation 

CHEPACHET’s  qualitative  representation  is  a  subset  of  the  qualitative  hy- 
perreal  representation;  landmarks  other  than  zero  are  not  allowed.  In  other 
words,  there  are  seven  possible  values:  ZERO,  ±SMALL  (infinitesimals), 
±MEDIUM  (finite,  noninfinitesimal  numbers,  and  ±LARGE  (infinite  num¬ 
bers).  Davis  asserts  [3]  that  it  is  easy  to  extend  his  representation  to  handle 
additional  orders  of  magnitude  (e.g.,  VERY-SMALL  and  VERY-LARGE), 
but  this  does  not  make  up  for  the  lack  of  multiple  landmarks  within  a  single 
order  of  magnitude. 

To  see  the  limitations  of  the  CHEPACHET  representation,  consider  the 
comparative  analysis  question  “What  happens  to  the  output  temperature  of 
hot  oil  passing  more  quickly  through  a  heat  exchanger?”  When  HR-QSIM  is 
given  the  description  of  oil  moving  infinitely  fast,  it  predicts  that  the  output 
heat  will  drop  a  negligible  amount  from  q0  to  (HALO  q0  — ).  Since  this 
is  greater  than  the  largest  predicted  value,  -<0,qo^>  in  the  case  where  oil 
velocity  is  finite,  the  scale  phase  can  conclude  that  output  heat  increases 
when  flow  rate  increases. 

But  CHEPACHET  could  not  support  this  deduction  without  some  con¬ 
tortions.  Assuming  that  CHEPACHET  correctly  predicts  that  Q  does  not 
transition  to  SMALL  or  ZERO  when  V  is  LARGE,  there  is  still  no  way  to 
compare  the  standard  and  hyperreal  output  values  to  see  which  is  larger. 
Both  (HALO  q0  -)  and  -<0, q0>-  are  represented  as  MEDIUM  in  the  CHEP¬ 
ACHET  representation. 

One  might  argue  that  there  is  a  simple  fix  to  the  problem:  simply  create 
a  new  parameter,  Q-LOST,  and  add  a  constraint  linking  it  to  Q.  This  new 
parameter  would  distinguish  the  two  cases  by  ending  with  a  value  of  -SMALL 
when  flow  is  infinite  and  -MEDIUM  when  oil  velocity  is  finite.  However,  there 
are  problems  with  adding  extra  parameters. 

Who  or  what  adds  the  new  parameters  to  the  model?  This  modeling 
step  should  not  be  lightly  undertaken  by  a  program,  yet  is  an  unattractive 
burden  for  a  person.  The  addition  of  numerous  new  parameters  complicates 
the  model  and  makes  it  harder  for  people  to  understand  and  harder  for 
programs  to  analyze.  Extensions  would  be  required  to  the  scale  phase  if  it 
were  required  to  automatically  analyze  the  Q-LOST  parameter  when  asked 
a  question  about  Q.  Since  an  additional  parameter  is  necessary  for  every 
landmark,  this  scheme  would  require  the  dynamic  addition  of  parameters 


Chapter  6 


Conclusions 


In  this  chapter,  I  summarize  the  main  contribution  of  the  thesis,  suggest 
areas  for  future  research,  and  present  a  few  concluding  remarks. 


6.1  Summary 

This  thesis  makes  a  number  of  contributions  to  the  field  of  qualitative  physics. 

•  It  formalizes  the  problem  of  comparative  analysis  and  distinguishes  it 
from  qualitative  simulation. 

•  It  solves  the  problems  with  previous  treatments  of  relative  change  by 
explicitly  accounting  for  multiple  perspectives. 

•  It  codifies  the  knowledge  necessary  for  performing  DQ  analysis  as  a  set 
of  inference  rules.  The  rules  are  proven  sound  and  have  been  imple¬ 
mented  using  a  forward  chaining  rule  engine. 

•  It  explains  how  the  qualitative  hyperreal  representation  extends  For- 
bus’  notion  of  quantity  space  [16]  to  handle  infinitesimal  and  infinite 
hyperreal  values. 

•  It  presents  predecessor-persistence  and  successor-arrival  filtering  and 
shows  how  they  are  used  in  a  simulator  that  uses  the  qualitative  hy¬ 
perreal  representation. 
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•  It  introduces  exaggeration,  a  novel  method  for  solving  comparative 
analysis  problems,  and  shows  how  qualitative  hyperreal  simulation  is 
central  to  its  operation. 

•  It  compares  the  two  comparative  analytic  techniques  on  a  wide  variety 
of  dimensions  so  that  future  researchers  can  easily  understand  their 
strengths  and  weaknesses  and  use  them  effectively  as  black  boxes. 

6.2  Future  Work 


As  is  often  the  case,  this  work  exposes  new  questions  as  it  answers  others. 
There  are  many  areas  that  deserve  further  attention. 

6.2.1  Augmenting  DQ  Analysis 


As  described  in  section  4.3.2,  small  changes  in  comparative  analysis  questions 
can  render  DQ  analysis  unable  to  answer.  Three  approaches  show  promise 
for  increasing  the  coverage  of  DQ  analysis: 

•  Since  the  DQ  analysis  rules  match  the  system  model  syntax,  small 
changes  in  the  model  (e.g.,  multiplication  of  a  derivative  by  a  constant) 
often  result  in  decreases  in  competence.  Can  the  models  be  converted 
into  some  kind  of  canonical  form? 

•  Sometimes  DQ  analysis  is  able  to  deduce  a  relative  change  values  for 
one  parameter,  but  not  for  other  parameters  even  if  their  value  is  de¬ 
termined  by  the  first’s.  For  example,  DQ  analysis  determines  that  an 
increase  in  the  fluid  pump  rate  between  two  adjacent  containers  re¬ 
sulted  in  a  greater  equilibrium  height  difference  (section  4.3.2)  but  is 
unable  to  conclude  that  this  means  one  level  is  higher  than  before  and 
the  other  lower.  Integrating  the  algebraic  methods  of  [47]  would  likely 
solve  this  and  related  problems. 

•  Proposition  21  states  that  relative  change  values  over  transition  inter¬ 

vals  are  not  exhaustive.  Given  a  parameter  X  and  a  perspective  P  it 
is  possible  that  neither  nor  X||^j+1p  nor  X(lp,l+1)  is  a  true 

statement.  As  a  result,  DQ  analysis  cannot  branch  on  the  possible  cases 
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in  the  hopes  of  eliminating  some  through  contradictions.  However,  rel¬ 
ative  change  values  at  transitions  (rather  than  the  intervals  between 
them)  are  exhaustive.  It  is  not  clear  how  great  an  advantage  limited 
branching  would  be,  but  it  would  at  least  solve  the  pumped  containers 
problem  described  in  the  bullet  above. 

6.2.2  Other  Uses  for  Exaggeration 

Although  this  thesis  has  treated  exaggeration  solely  from  the  standpoint  of  a 
comparative  analysis  technique,  exaggeration  has  a  much  greater  potential. 

Section  3.2.1  suggests  how  exaggeration  might  be  used  to  solve  a  com¬ 
parative  analysis  question  that  is  not  differential  in  nature:  “Which  heat  ex¬ 
changer  can  cool  to  a  lower  temperature,  the  regular  or  counterflow  design?” 
The  question  is  different  from  the  other  comparative  analysis  problems  dis¬ 
cussed  because  the  difference  between  the  two  systems  cannot  be  expressed  as 
a  differential  change  in  a  parameter.  In  one  system  velocity  is  positive  and  in 
the  other  it  is  negative.  Exaggeration  can  be  used  to  answer  the  question,  but 
only  through  an  obscure  transformation.  If  the  heat  exchanger  is  infinitely 
long  then  the  oil  will  be  in  thermal  equilibrium  as  it  exits.  Thus  in  one  oil 
will  exit  the  counterflow  exchanger  at  a  lower  temperature,  the  temperature 
at  which  the  coolant  enters.  Future  work  should  be  spent  on  developing  a 
theory  of  exaggeration’s  applicability  to  nondifferential  comparative  analysis 
problems.  Specifically,  what  parameter  should  be  transformed? 

Another  example  of  exaggeration’s  potential  utility  as  a  subroutine  is 
shown  by  the  comparative  analysis  problem:  “When  traveling  a  fixed  distance 
in  the  rain,  will  you  stay  drier  by  running?”  To  model  this  situation,  I  make 
the  following  assumptions.  The  rain  is  falling  straight  down  with  uniform 
density.  The  person  is  a  stick  figure,  leaning  forward  at  an  angle,  0,  from 
vertical.  Finally,  the  person  only  gets  wet  on  his  sides,  not  on  the  top  of  his 
head  (which  has  zero  area  and  is  protected  by  a  tiny  hat  anyway).  Straight 
exaggeration  might  lead  one  to  think  that  wetness  is  independent  of  speed. 
After  all,  if  one  were  to  move  infinitely  fast, one  would  get  soaked  by  all  the 
rain  in  the  volume  swept  out.  But  if  one  moved  with  infinitesimal  speed, 
then  it  would  take  an  infinite  time  to  get  there  and  one’s  back  would  get 
soaked  (remember  that  the  figure  is  angled  forward).  This  answer  is  incorrect 
because  the  system  behaves  nonmonotonically  to  changes  in  speed.  In  fact, 
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exaggeration  can  be  used  to  show  that  every  angle,  8 ,  specifies  a  unique  speed 
that  will  allow  the  figure  to  traverse  the  distance  without  being  touched  by  a 
single  drop  of  rain.  Suppose  the  person  were  prone,  8  =  90°,  then  if  he  could 
fly  infinitely  fast  he  wouldn’t  get  touched.  If  the  figure  is  completely  vertical, 
8  =  0°,  then  standing  still  keeps  him  dry;  8  =  negl  degrees  necessitates 
a  negligible  speed.  Again,  the  question  for  research  is  how  to  choose  the 
correct  transformation  and  how  to  use  the  simulation  results. 

6.2.3  Reasoning  about  Discontinuous  Systems 

Although  DQ  analysis  and  exaggeration  are  both  limited  to  continuous  sys¬ 
tems,  many  systems  are  discontinuous.  How  could  the  techniques  of  compar¬ 
ative  analysis  be  extended  to  handle  such  systems?  One  possible  approach 
would  be  to  model  the  system  in  terms  of  piecewise  continuous  fragments. 
How  would  the  individual  models  be  created?  How  would  an  overall  answer 
be  composed  from  the  trends  of  the  pieces? 

An  interesting  example  (suggested  by  Paul  Horwitz)  to  consider  is  that 
of  a  rocket  navigating  under  the  following,  rather  strange  conditions.  The 
rocket  is  not  subject  to  gravity,  but  does  experience  linear  friction:  doubling 
initial  velocity  causes  the  rocket  to  go  twice  as  far  before  coming  to  rest.  If 
we  assume  that  the  space  is  one  dimensional,  the  friction  law  can  be  written 
V  =  V0  -  kX.  Finally,  assume  that  instead  of  engines,  the  rocket  has  a 
keypad.  When  the  pilot  types  an  integer  value,  that  number  is  added  to  the 
ships  current  velocity.  The  ship’s  initial  velocity  is  zero. 

If  there  is  no  friction,  k  =  0,  then  the  rocket  can  stop  at  any  position 
with  the  following  simple  procedure:  type  one  on  the  keypad  (or  minus  one 
if  the  desired  point  is  to  the  left),  wait  until  reaching  the  point,  type  minus 
one.  However,  if  there  is  friction,  then  the  rocket  can  only  stop  at  certain 
discrete  points.  Clearly,  one  of  these  points  is  reached  by  typing  one  and 
waiting  for  friction  to  bring  the  ship  to  a  halt  at  X  =  x0.  However,  it  may 
be  less  clear  that  there  is  no  way  to  stop  before  a:0.  Suppose  the  captain 
tries  typing  minus  one  halfway  between  the  origin  and  x0.  Before  typing  the 
number,  friction  will  have  reduced  the  velocity  from  one  to  one  half.  Adding 
minus  one  to  one  half  gives  minus  one  half.  Thus  the  ship  will  cruise  back 
and  stop  at  the  origin.  Any  attempt  to  stop  at  a  location  other  than  Nx0 
for  integer  N  is  futile. 
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Now  consider  a  comparative  analysis  question:  “What  happens  to  the 
distance  between  stopping  points  if  friction  is  decreased?”  Recalling  the  case 
for  zero  friction,  one  might  be  tempted  to  answer  that  the  distance  between 
resting  points  will  decrease.  In  fact  the  opposite  is  true  —  halving  the  friction 
doubles  the  distance  between  stopping  points.  The  mystery  boils  down  to 
a  simple  discontinuity.  If  there  is  zero  friction,  one  can  stop  anywhere,  but 
if  there  is  negligible  friction,  one  can  only  stop  at  the  origin  and  at  infinity. 
Can  a  comparative  analysis  program  make  sense  of  system’s  like  this? 

6.2.4  Reasoning  with  Multiple  Models 

Despite  the  obvious  utility  of  qualitative  physics,  there  are  serious  prob¬ 
lems  with  all  qualitative  reasoning  techniques  proposed  so  far.  The  inherent 
ambiguity  of  the  qualitative  algebra  underlying  these  techniques  seems  to 
be  unavoidable  [40].  The  resulting  exponential  branching  limits  qualitative 
simulation  and  comparative  analysis  techniques  to  small  models  of  no  more 
than  a  dozen  parameters.  Future  work  must  focus  on  ways  to  reason  about 
larger,  more  complex  systems.  One  promising  way  to  do  this  is  by  the  use 
of  multiple  models  of  a  system.  Each  model  could  encode  a  particular  way 
of  looking  at  the  system  (distinguished  by  different  simplifying  assumptions) 
appropriate  for  a  specific  class  of  problems.  The  following  issues  need  to  be 
solved.  Given  a  problem,  how  is  an  appropriate  model  selected?  Given  a 
model  and  a  solution  generated  from  the  model,  how  can  one  be  sure  that 
the  solution  is  sufficient  (in  other  words  how  can  one  be  sure  that  the  model 
was  appropriate?)  What  structures  the  space  of  possible  models?  How  can 
one  switch  between  models? 

Several  researchers  have  done  work  that  is  relevant  to  this  approach. 
Randy  Davis’  hardware  troubleshooter  [5]  introduces  more  complex  models 
of  a  circuit  when  simple  models  fail  to  explain  the  misbehavior.  Patil’s  ABEL 
program  [31]  built  multilevel  causal  descriptions  of  a  human  patient’s  illness. 
Kuipers  models  a  kidney  with  time-scale  abstraction  [26]  to  reduce  ambiguity. 
Weld’s  theory  of  aggregation  [44]  explains  how  new  models  of  a  system’s 
behavior  can  be  constructed  dynamically  and  used  in  qualitative  simulation. 
Collins  and  Forbus  [2]  discuss  ways  of  integrating  multiple  models  of  fluid 
processes.  This  is  an  exceptionally  important  area  for  research. 


6.2.5  Mixed  Qualitative  Quantitative  Reasoning 

While  qualitative  reasoning  has  its  place,  it  isn’t  appropriate  for  quantitative 
problems.  For  some  time  researchers  have  given  lip  service  to  the  problem  of 
integrating  the  two  approaches,  but  little  has  been  done.  Simmons’  quantity 
lattice  [39]  and  Sacks’  QMR  program  [37]  are  notable  exceptions.  The  key 
issue  is  not  so  much  developing  a  representation  which  unifies  both  types  of 
reasoning,  rather  understanding  when  each  is  appropriate,  and  knowing  how 
one  type  of  reasoning  affects  the  model  for  the  other.  Thus  this  area  of  work 
has  much  in  common  with  that  of  the  previous  section. 


6.3  Conclusions 

DQ  analysis  and  exaggeration  have  been  tested  on  dozens  of  simple  compara¬ 
tive  analysis  examples  from  the  domains  of  mechanics,  thermodynamics  and 
electronics.  Both  techniques  can  be  used  to  generate  symbolic  explanations 
for  how  and  why  the  behavior  of  a  system  will  change  given  a  structural 
perturbation.  Both  techniques  work  well  on  many,  but  not  all  comparative 
analysis  questions. 

DQ  analysis  is  sound;  whenever  it  deduces  an  answer,  the  answer  is  guar¬ 
anteed  to  be  correct.  Exaggeration,  on  the  other  hand,  will  frequently  an¬ 
swer  incorrectly  for  systems  in  which  the  perturbation  causes  nonmonotonic 
changes  in  parameter  values.  Unfortunately,  there  appears  to  be  no  general, 
qualitative  method  of  ensuring  that  a  system  reacts  monotonically. 

On  the  other  hand,  exaggeration  appears  to  solve  many  more  compara¬ 
tive  analysis  problems  than  does  DQ  analysis.  Both  techniques  solve  some 
problems  that  stump  the  other,  but  exaggeration  has  the  upper  hand.  The 
difference  lies  in  DQ  analysis’  reliance  on  syntactic  matching  of  rules  to  the 
differential  equation  model.  To  handle  every  case,  DQ  analysis  would  need 
to  solve  the  intractable  problem  of  simplifying  equations  to  canonical  form. 
Exaggeration,  however,  needs  only  to  evaluate  the  equations,  not  prove  them 
equivalent,  to  predict  relative  change  values. 

The  two  techniques  complementary  strengths  suggest  a  powerful  high 
level  architecture.  Given  a  problem,  first  try  to  solve  it  with  DQ  analysis. 
If  that  works,  then  a  sound  answer  is  guaranteed.  If  DQ  analysis  fails,  then 
apply  exaggeration.  Now  check  exaggeration’s  predictions  with  all  of  the  rel- 
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ative  change  values  that  DQ  analysis  is  able  to  deduce.  If  they  all  agree,  the 
chances  are  good  that  nonmonotonic  behavior  is  absent.  Finally,  exaggerate 
the  perturbation  in  the  opposite  direction  and  check  that  the  resulting  pre¬ 
dictions  are  the  opposite  of  the  first  transformation.  Although  there  will  still 
be  pathological  cases,  these  precautions  maximize  the  heuristic  power  of  the 
exaggeration  method. 
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Appendix  A 
Glossary 


The  glossary  starts  with  a  list  of  symbol  types  that  clarifies  some  of  the  math 

in  this  thesis,  then  moves  on  to  specific  terms  in  alphabetic  order.  Whenever 

appropriate  a  reference  is  made  to  the  best  description  of  the  term  in  the 

text. 

Caligraphic  Letters  Denote  sets  of  real  or  hyperreal  numbers,  except  S 
which  denotes  a  qualitative  state  and  T  which  denote  a  function  from 
transitions  *o  times.  (Section  2.1.2). 

Lowercase  Letters  Denote  specific  real  or  hyperreal  values.  For  example, 
v0  might  be  the  initial  velocity  of  some  object. 

Uppercase  Greek  Letters  Denote  qualitative  values. 

Uppercase  Letters  Denote  parameters  in  a  system.  For  example,  V  fre¬ 
quently  denotes  velocity.  (Section  2.1). 

- <a,b> -  Signifies  an  open  interval  of  finite  numbers  between  a  and  b  and  not 
including  the  infinitesimals  surrounding  a  or  b.  (Section  3.1.2). 

~  Signifies  the  perturbed  system. 

7,  The  ith  transition.  See  transition. 

1)  The  relative  change  value  signifying  that  the  perturbed  system  is  greater 
than  the  original.  (Section  2.1.2). 
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The  relative  change  value  signifying  that  the  perturbed  system  is  equal  to 
the  original.  (Section  2.1.2). 


(1  The  relative  change  value  signifying  that  the  perturbed  system  is  less  than 
the  original.  (Section  2.1.2). 


ARK  A  version  of  AMORD  used  to  implement  DQ  analysis. 
Behavior  A  sequence  of  qualitative  states.  (Section  2.1). 


Behavioral  Topology  The  ordered  sequence  of  transitions  that  distinguishes 
one  behavior  from  other  possible  paths  through  the  tree  of  states  pro¬ 
duced  by  the  qualitative  simulator.  (Section  2.5). 


CO-transition  A  change  in  value  from  a  closed  point  to  an  open  interval. 
(Section  3.3.2). 


Covering  Perspective  A  parameter  which  is  strictly  monotonic  over  an 
interval  between  two  transitions  and  which  has  the  same  value  at  both 
transitions  in  both  the  original  and  perturbed  systems.  (Section  2.1.3). 


dec  Signifies  that  a  parameter  is  decreasing,  i.e.  its  derivative  is  negative. 


DISTANCE  The  distance  between  two  qualitative  hyperreal  values.  For  ex¬ 
ample,  the  distance  between  (HALO  0  +)  and  -<0,  inf>-  is  fin.  Used  by 
the  successor-arrival  filter.  (Section  3.3.5). 


Distance-Rate-Time  Table  A  table  for  computing  the  time  required  to 
traverse  a  given  distance  (or  width)  at  a  given  rate.  (Figure  3.11  in 
section  3.3.4). 


Distinguished  Time  Point  The  time  when  a  parameter  reaches  a  land¬ 
mark  value.  (Section  2.1). 


Duration  Rule  The  duration  rule  formalizes  “distance  equals  rate  times 
time”  for  DQ  analysis.  (Section  2.2.1). 


fin  Finite.  An  order  of  magnitude:  greater  than  all  infinitesimals  but  smaller 
than  any  infinite  number. 
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HALO  Every  real  number  has  a  halo  of  hyperreal  numbers  surrounding  it, 
infinitesimally  closely.  (Section  3.1.2). 

HR-QDIR  Hyperreal  qualitative  direction:  a  pair  of  a  standard  qualitative 
direction  ( inc ,  dec ,  or  std)  and  an  order  of  magnitude.  (Section  3.1.2). 

HR-QR  The  hyperreal  qualitative  representation  of  a  parameter’s  state  con¬ 
sisting  of  the  pair  of  the  parameter’s  value  and  its  derivative:  (HR-QVAL, 
HR-QDIR).  (Section  3.1.2). 

HR-QSIM  An  implementation  of  the  simulate  phase  of  exaggeration.  The 
hyperreal  qualitative  simulator.  (Section  3.3). 

HR-QVAL  A  hyperreal  qualitative  value,  for  example  a  landmark  value,  a 
halo,  a  finite  interval,  inf,  or  minf.  (Section  3.1.2). 

Hyperreal  Numbers  The  field  of  numbers  which  include  the  standard  reals 
as  well  as  infinitesimals  and  infinities.  (Section  3.1.1). 

inc  Signifies  that  a  parameter  is  increasing,  i.e.  its  derivative  is  positive. 

inf  Infinity.  Both  an  order  of  magnitude  and  a  possible  value  in  the  qualita¬ 
tive  hyperreal  representation.  (Section  3.1.1). 

Infinite  Arrival  Rule  A  rule  which  says  that  a  parameter  will  take  only 
negligible  time  to  reach  infinity  from  a  finite  value  if  it  is  going  infinitely 
fast.  (Section  17). 

Interval  Derivative  Rule  A  rule  that  expresses  the  relationship  between 
one  derivative  and  another,  e.g.,  “greater  acceleration  leads  to  higher 
velocity.”  (Section  2.2.2). 

Landmark  Value  An  important  qualitative  value  of  a  parameter.  Often 
distinguished  by  the  modeler,  but  sometimes  deduced  by  a  program. 
(Section  2.1). 

minf  Minus  infinity  a  possible  value  in  the  qualitative  hyperreal  representa¬ 
tion.  (Section  3.1.1). 


negl  Negligible.  Both  an  order  of  magnitude  and  a  possible  value  in  the 
qualitative  hyperreal  representation.  The  same  thing  as  infinitesimal. 
(Section  3.1.1). 

Next  Value  Tables  Tables  used  to  generate  the  possible  next  values  of  each 
parameter.  (Section  3.3.2). 

Nonstandard  Analysis  A  theory  of  calculus  developed  by  Abraham  Robin-v 
son  that  gives  a  consistent  formalization  of  the  notion  of  infinitesimal 
numbers.  (Appendix  C). 

NS-transition  A  change  in  value  from  a  nonstandard  open  interval  to  a 
standard  open  interval.  For  example,  from  inf  to  (Section 

3.3.2). 

OC-transition  A  change  in  value  from  an  open  interval  to  a  closed  point. 
(Section  3.3.2). 

OM  The  order  of  magnitude  part  of  the  qualitative  hyperreal  representation 
of  derivative.  (Section  ??). 

Parameter  Defined  as  a  reasonable  function  of  time.  Used  to  represent  a 
variable  in  a  system.  For  example,  V  frequently  denotes  velocity  as  a 
function  of  time.  (Section  2.1). 

Partial  Perspective  A  parameter  which  is  strictly  monotonic  over  an  in¬ 
terval  between  two  transitions,  but  which  does  not  necessarily  have 
the  same  value  at  both  transitions  in  both  the  original  and  perturbed 
systems.  (Section  2.1.3). 

Perspective  See  partial  perspective. 

Predecessor-Persistence  Filter  A  simulation  technique  for  eliminating 
inconsistent  states  by  checking  the  amount  of  time  a  parameter’s  qual¬ 
itative  value  persists.  (Section  3.3.4). 

QDIR  QSIM’s  qualitative  representation  for  the  direction  a  parameter  is  mov¬ 
ing.  Either  me,  dec ,  or  std.  (Section  2.1). 

QS  A  QSIM  qualitative  state.  (Section  2.1). 
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QSIM  Kuipers’  program  for  qualitative  simulation  [27]. 

Qualitative  Hyperreal  Representation  An  extended  quantity  space  rep¬ 
resentation  that  includes  infinitesimal  and  infinite  values.  Used  by  ex¬ 
aggeration.  (Section  3.1.2). 

QVAL  QSIM  Qualitative  value.  (Section  2.1). 

Relative  Change  A  notation  used  by  DQ  analysis  to  describe  how  a  pa¬ 
rameter  changes  value.  Possible  values  are:  ff,  II,  and  ||.  (Section  2.1.2). 

RC  See  relative  change. 

S  A  variable  denoting  a  qualitative  state. 

Scale  Phase  The  final  phase  of  exaggeration  which  compares  standard  and 
hyperreal  qualitative  behaviors  to  answer  a  comparative  analysis  ques¬ 
tion.  (Section  3.4). 

Simulate  Phase  The  middle  phase  of  exaggeration  which  simulates  the  ex¬ 
aggerated  system  produced  by  the  transform  phase.  (Section  3.3). 

SN-transition  A  change  in  value  from  a  standard  open  interval  to  a  non¬ 
standard  open  interval.  For  example,  from  -<0,  inj>- to  inf.  (Section 
3.3.2). 

State  Tree  The  tree  of  states  generated  by  QSIM  or  HR-QSIM.  Any  path 
through  this  tree  is  a  behavior. 

std  Signifies  that  a  parameter  is  not  changing,  i.e.  its  derivative  is  zero. 

Structural  Description  A  set  of  qualitative  differential  equations  that  re¬ 
lates  the  various  parameters  in  a  system.  (Section  2.1). 

Successor-Arrival  Filter  A  simulation  technique  for  eliminating  inconsis¬ 
tent  states  by  checking  the  amount  of  time  a  parameter  takes  to  arrive 
at  the  next  qualitative  value.  (Section  3.3.5). 

System  A  group  of  parameters  related  by  a  structural  description.  (Section 

2.1). 


T  The  time  function,  which  takes  transitions  to  the  times  when  they  occur. 
(Section  2.1.2). 

Topologically  Equal  See  behavioral  topology. 

Transform  Phase  The  first  phase  of  exaggeration.  It.  takes  the  perturba¬ 
tion  from  the  comparative  analysis  problem  and  constructs  and  exag¬ 
gerated  system  description  which  is  simulated  by  the  simulate  phase. 
(Section  3.2). 

Transition  The  event  when  a  parameter  changes  from  one  qualitative  value 
to  another.  A  transitions  is  written  as  a  lowercase  gamma:  7.  (Section 
2.1). 

WIDTH  The  qualitative  value  of  the  maximum  difference  between  two  hy- 
perreal  numbers  that  share  a  qualitative  hyperreal  value.  For  example, 
the  width  of  (HALO  0  +)  is  negl.  (Section  3.3.4). 
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Appendix  B 

A  Useful  Example 


This  section  constructs  an  example  which  serves  both  as  a  counter-example 
for  a  generalized  version  of  the  derivative  rule  and  as  the  proof  of  the  non- 
exhaustive  proposition.  Suppose  that  A,  V ,  and  X  are  parameters  such  that 
A  =  jtV ,  V  =  ^A,  and  A  is  a  covering  perspective  over  (7i,7i+i).  The 
derivative  rule  (proposition  3)  showed  that  if  A  and  V  are  positive  over  the 
interval  (7.,7i+i)  and  if  -'V'fto  and  A.l(*<+1),  then 

Unfortunately,  the  derivative  rule  is  not  true  for  arbitrary  perspectives. 
The  following  abberation  should  convince  you  of  this.  I  show  three  parame¬ 
ters,  V,  A ,  and  P  such  that  A  —  V  and  P  is  a  covering  perspective  over 
(7o>7i)-  Yet  although  A||(0tlj  the  parameter  V  has  no  consistent  behavior 
from  the  perspective  of  P.  During  part  of  the  interval  Ufp  and  during  part 
UJ(P. 

Here  are  the  details.  Over  the  absolute  time  interval  (0, 1)  define: 

V(t)  = 

A(t)  =  ±V(t)  =  t  A~1{a)  =  a 
P(t)  =  A(t)  =  t  P~l(p)  =  P 

m  =  1 13 

A(t)  =  &V(t)  =  t 2  A-‘(a)  =  «* 

P(t)  =  A(t)  =  t2  P-I(p)  =  p? 

Note  that  P( 0)  =  P( 0)  =  0  and  P(l)  =  P(l)  =  1  and  P  is  strictly  monotonic, 
so  P  is  a  valid  perspective  over  this  interval.  Since  P  =  A  and  P  =  A  the  self 
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esponaing  v  is  larger  man  v,  uui  roi  larger  p 
t  is  neither  the  case  that  ^ ftfo,  1 )  nor  ^ll(o,i) 


Appendix  C 

Readings  in  Nonstandard 
Analysis 

There  are  a  wide  variety  of  sources  for  people  who  wish  to  learn  more  about 
nonstandard  analysis,  but  most  of  them  are  old  or  out  of  print.  A  Scientific 
American  article  [4]  by  Davis  and  Hersh  is  a  good  starting  point;  it  provides 
a  good  history  and  flavor  for  the  material  but  does  not  present  any  tech¬ 
nical  details.  Henle  and  Kleinberg  [22]  have  a  book  designed  for  use  in  a 
freshman  calculus  class.  Assuming  no  mathematical  background,  it  defines 
the  infinitesimals  and  shows  how  they  can  be  used  to  define  derivatives  and 
integrals.  The  book  is  easy  to  understand,  but  is  so  slow  and  devoid  of  proofs 
that  it  is  rather  frustrating  to  read.  Keisler  has  two  books  on  the  subject. 
One  is  similar  to  Henle  and  Kleinberg,  an  alternative  book  for  college  fresh¬ 
man,  the  other,  [25],  is  for  teachers  who  are  using  the  first.  This  teacher’s 
guide  is  the  best  book  for  people  who  are  mathematically  literate  yet  not 
experts.  Specifically,  no  background  in  model  theory  is  required.  The  treat¬ 
ment  is  elegant  and  all  theorems  are  proven.  Robinson  [33]  is  the  classic 
source  as  he  figured  it  all  out.  Unfortunately,  his  text  assumes  considerable 
sophistication  and  a  strong  background  in  model  theory. 


Appendix  D 

HR-QSIM  Transition  Tables 

This  section  contains  the  procedural  encoding  of  the  qualitative  hyperreal 
transition  tables  discussed  in  section  3.3.2.  There  are  four  types  of  transi¬ 
tions:  CO-transitions  have  a  topology  which  is  closed  on  the  left  yet  open  on 
the  right,  OC- transitions  are  open  on  the  left  and  closed  on  the  right,  and 
both  NS-  and  SN-transitions  have  an  open-open  topology. 

Each  of  the  transition  functions  takes  four  arguments:  hr-qval  is  the 
parameter’s  current  value  (e.g.,  (HALO  0  +)),  qdir  and  om  are  the  two  com¬ 
ponents  of  the  parameter’s  current  HR-QDIR  (e.g.,  inc  and  negl ),  and  qspace 
is  the  parameter’s  quantity  space,  i.e.,  an  ordered  list  of  its  landmark  values. 
Each  of  the  transition  functions  returns  a  list  of  possible  next  values.  The  car 
of  each  ‘next-value’  is  the  HR-QVAL  and  the  cadr  is  the  HR-QDIR,  repre¬ 
sented  as  a  two  element  list:  (qdir  om).  Since  finite  intervals  are  represented 
as  two  element  lists,  they  look  indistinguishable  from  QSIM  open  intervals.1 
Thus  the  qualitative  hyperreal  representation  (-<0,  infi~,(dec  negl))  is  repre¬ 
sented  by  the  following  list:  ((0  inf)  (dec  neg)). 

lThe  representation  is  unique,  however,  because  open  intervals  are  not  used  by  HR- 
QSIM. 
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;  HR-QVAL  closed  -  can  change 
;  HR-QDIR  can  change  too 


(defun  CO-TRANSITIONS  (hr-qval  qdir  on  qspace) 

(ignore  qspace) 

(if  (landmark?  hr-qval) 

(if  (eql  qdir  ’std) 

(list  ‘((halo  , hr-qval  +)  (inc  neg)) 

'((halo  ,hr-qval  -)  (dec  neg)) 

'(, hr-qval  (std  0))) 

(list  ‘((halo  , hr-qval  ,(if  (eql  qdir  ’inc)  ’+  ’-))  (.qdir  ,om)))) 
;;  else  HR-QVAL  is  not  closed  and  can't  change. 

(if  (eql  qdir  ’std) 

(list  ‘(, hr-qval  (std  0))  ;  HR-QDIR  can  change 

‘(.hr-qval  (inc  neg)) 

‘(.hr-qval  (dec  neg))) 

(list  *(, hr-qval  (.qdir  ,om))))))  ;  HR-QDIR  can’t  change 


(defun  OC-TRAHSITIONS  (hr-qval  qdir  om  qspace) 
(ignore  qspace) 

(if  (and  (landmark?  hr-qval) 

(member  qdir  ’(inc  dee))) 

nil 

(product-space 

(list  (cons  hr-qval 

(if  (and  (halo?  hr-qval) 

(or  (and  (eql  qdir 
(and  (eql  qdir 
(list  (cadr  hr-qval)) 
nil)) 

(cons  ‘(.qdir  .om) 

(if  (eql  om  ’neg) 

’((std  0)) 
nil)))))) 


;  Must  change  but  can’t 

;  Old  HR-QVAL  still  ok 

’inc)  (eql  (caddr  hr-qval)  ’-)) 
’dec)  (eql  (caddr  hr-qval)  ’+)))) 
;  Halo  center  also  possible 
;  No  other  possible  HR-QVALs 
;  Old  HR-QDIR  is  always  ok 

;  Also  param  could  stop 
;  Not  in  this  case 


(defun  NS-TRANSITIONS  (hr-qval  qdir  om  qspace) 
(cond  ((eql  qdir  ’std) 

(list  ‘(.hr-qval  (,qdir  ,om)))) 
((landmark?  hr-qval) 
nil) 

((or  (finite-interval?  hr-qval) 

(and  (eql  hr-qvaL  ’inf)  (eql  qdir 
(and  (eql  hr-qval  ’minf)  (eql  qdir 
(and  (halo?  hr-qval)  (or  (and  (eql 
(eql  qdir  ’dec)) 

(and  (eql  (caddr  hr-qval)  ’-) 

(eql  qdir  ’inc))))) 


;  No  change  possible 

;  Inconsistent 
;  Stan  HR-QVAL  can’t  chng 
’inc))  ;  Nor  these  nonstandards 
’ dec ) ) 

(caddr  hr-qval)  ’+) 


(product- space  (list  ‘(.hr-qval)  (ns-hr-qdir-transitions  qdir  on)))) 

(t  ;  Honstans  that  can  chng 

(lat  ((alt  (cond  ((eql  hr-qval  ’mini) 

'(mini  ,(succ  'mini  qspace))) 

((eql  hr-qTal  'ini) 

' (,(pred  ’ini  qspace)  ini)) 

((eql  (caddr  hr-qval)  ’  +  ) 

‘(,(cadr  hr-qval)  ,(succ  (cadr  hr-qval)  qspace))) 
((eql  (caddr  hr-qval)  '-) 

' (,(pred  (cadr  hr-qval)  qspace)  .(cadr  hr-qval)))))) 
(product-space  (list  '(.hr-qval  ,alt) 

(ns-hr-qdir-transitions  qdir  om))))))) 

(delun  SH-TRAISITIOHS  (hr-qval  qdir  om  qspace) 

(ignore  qspace) 

(cond  ((eql  qdir  *std)  ;  Deriv  can’t  change 

(list  '(, hr-qval  (.qdir  .om))))  ;  ...  so  HR-QTAL  stuck 

((landmark?  hr-qval) 

nil)  ;  Must  change  but  can’t 

((linite-interval?  hr-qval)  ;  These  can  change 

(let  ((alt  (cond  ((and  (eql  qdir  ’inc) 

(eql  (cadr  hr-qval)  ’ini)) 

’ini) 

((and  (eql  qdir  ’dec) 

(eql  (car  hr-qval)  ’mini)) 

’mini) 

((eql  qdir  ’inc)  '(halo  .(cadr  hr-qval)  -)) 

(t  '(halo  .(car  hr-qval)  +))))) 

(product-space  (list  '(.hr-qval  .alt) 

(sn-hr-qdir-transitiona  qdir  om))))) 

(t  ;  Nona tan  HR-QVALs  can’t  change 

(product-space  (list  *(,hr  qval) 

(sn-hr-qdir-transitions  qdir  om)))))) 

The  following  two  utility  functions  determine  whether  a  parameter’s  HR- 
QDIR  can  change  given  the  type  of  transition  (NS-  or  SN-)  being  considered. 

For  example,  if  a  HR-QDIR  changes  from  ( inc  negl)  to  ( inc  FIN)  that  is 
an  NS-  transition  since  the  parameter’s  derivative  must  have  transitioned 
from  (HALO  0  T)  to  -<0,  inf>-  for  the  HR-QDIR  to  change.  Since  the  system 
model  may  not  have  provided  an  explicit  parameter  name  for  the  derivative, 
it  is  best  to  check  derivative  transitions  at  this  point  rather  than  count  on 
constraint  filtering  to  eliminate  inconsistencies. 

(dalun  HS-HR-QDIR-TRAISITIOHS  (qdir  om) 


BlIHgiJM'JWJMlW'MIWIWUW  JCT IWM  HU  VS  U  •  ^TV  yysil  KUXUirj  w  WV  row**  ruro  m  xk-.jdi 


(case  on 

(0  ‘((.qdir  ,om))) 

(nog  '((.qdir  ,om)  C.qdir  fin))) 
(fin  ‘((,qdir  ,om))) 

(inf  ‘((.qdir  ,om)  (.qdir  fin))))) 


HR-QDIR  can’t  change 


(defnn  SH-HR-QDIR-TRiHSITIOIS  (qdir  om) 

(case  on 

(0  ‘((.qdir  ,om))) 

(neg  ‘((.qdir  ,om))) 

(fin  ‘((.qdir  ,om)  (, qdir  neg)  (.qdir  inf))) 
(inf  ‘((.qdir  ,om))))) 
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Appendix  E 

Program  Output  for  the 
Spring  and  Block 


This  chapter  shows  the  actual  behavior  of  the  current  implementation  of  DQ 
analysis  and  exaggeration  on  the  example  of  a  block  attached  to  a  spring  on  a 
horizontal,  frictionless  table.  The  model  includes  explicit  energy  conservation 
equations  to  reduce  ambiguity.  The  next  section  presents  the  actual  code 
input  description.  Following  sections  show  the  output  generated  by  the  two 
techniques  given  an  increase  in  the  mass  of  the  block. 


E.l  Model  of  the  System 


(define-QDE  LIHEAR-SPRIHG-W-EC 
(independent  M  K  TE) 

(dependent  A  X  V  F  VV  KE  PE) 

(boundary  1  V  N  K) 

(print-name*  (A  "Acceleration") 

(V  "Velocity") 

(I  "Position") 

(F  "Force") 

(M  "Mass") 

(K  "Spring  Constant")) 
(VV  "Velocity  Squared")) 
(KE  "Kinetic  Energy")) 
(PE  "Potential  Energy")) 
(TE  "Total  Energy")) 


;  Define  qual.  differential  eq. 

;  These  parameters  are  constants 
;  These  parameters  may  change 
;  These  parameters  may  be  perturbed 
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(constraints  ((d//dt  X  V)) 

((d//dt  7  A)) 

((mult  M  A  F)) 

((mult  X  K  F)) 

((mult  7  7  77)) 

((mult  77  M  KE)) 

((mult  F  F  PE)) 

((add  PE  KE  TE})) 

(quantity-spaces  (K  (mini  k*  0  inf ) ) 

(M  (minf  0  m*  inf)) 

(TE  (minf  0  te*  inf)))) 


7el  =  position's  time  deriv 
Definition  of  acceleration 
Hevton’s  second  law  of  motion 
Hooke's  lam 

Definition  of  velocity  squared 
Definition  of  kinetic  energy 
Cheating  definition  of  PE 
Definition  of  total  energy 
Spring  constant,  k*,  is  negative 

Landmark  te*  is  positive 


(define-init  RELEASE-DISPLACED 
linear-spring-w-ec 
((X  ((minf  0)  std)) 

(F  ((0  inf)  std)) 

(A  ((0  inf)  std)) 

(TE  (te*  std)) 

(M  (m*  std)) 

(K  (k*  std)) 

(7  (0  inc)))) 


;  Define  named  initial  conditions 
;  for  this  qualitative  diff.  eq. 

;  X  is  initially  between  minf  A  0 


;  Mass  is  steady  at  landmark  m* 


;  7  is  at  landmark  0  A  increasing 


E.2  DQ  Analysis  Output 

When  the  user  selects  the  model  shown  above,  the  CA  program  applies  QSIM 
to  it,  producing  a  single  behavior  corresponding  to  stable  oscillation.  Next 
a  propositional  encoding  of  the  model,  the  behavior,  and  a  perturbation 
(A/fto)  are  loaded  into  the  database.  Then  ARK  applies  inference  rules  to 
deduce  as  many  relative  change  values  as  possible.  When  no  more  rules 
match,  the  database  contents  are  displayed.  For  simplicity,  only  relevant 
database  propositions  are  printed  (e.g.,  the  propositional  encoding  of  the 
system  behavior  is  not). 


Tim* :  0 

(RC  7  0  DEQ) 
(RC  X  0  DEQ) 
(RC  M  0  DOP) 
(RC  K  0  DEQ) 
(RC  F  0  DEQ) 


;  This  is  tho  initial  perturbation 
;  Spring  constant  unchanged 
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(EC  A  0  ODI) 
(EC  PB  0  DBQ) 
(EC  VV  0  DBQ) 
(EC  KB  0  DBQ) 
(EC  TB  0  DBQ) 


e:  (0  1) 

(EC  V  (0  1) 
(EC  V  (0  1) 
(EC  V  (0  1) 
(EC  v  (0  1) 
(EC  X  (0  1) 
(EC  X  (0  1) 
(EC  X  (0  1) 
(EC  X  (0  1) 
(EC  M  (0  1) 
(EC  N  (0  1) 
(EC  N  (0  1) 
(EC  M  (0  1) 
(EC  K  (0  1) 
(EC  K  (0  1) 
(EC  K  (0  1) 
(EC  K  (0  1) 
(EC  P  (0  1) 
(EC  F  (0  1) 
(EC  F  (0  1) 
(EC  F  (0  1) 
(EC  A  (0  1) 
(EC  A  (0  1) 
(EC  A  (0  1) 
(EC  A  (0  1) 
(EC  PE  (0  1) 
(EC  PE  (0  1) 
(EC  PB  (0  1) 
(EC  PE  (0  1) 
(EC  TV  (0  1) 
(EC  VV  (0  1) 
(EC  VV  (0  1) 
(EC  VV  (0  1) 
(EC  KB  (0  1) 
(EC  KB  (0  1) 
(EC  KB  (0  1) 
(EC  KB  (0  1) 
(EC  TB  (0  1) 


DDK  (C- 
DDK  (C- 
DDK  (C- 
DDK  (C- 
DEQ  (C- 
DBQ  (C- 
DEQ  (C- 
DEq  (C- 
DUP  (C- 
DUP  (C- 
DDP  (C- 
DUP  (C- 
DEQ  (C- 
DEQ  (C- 
DEq  (C- 
DEq  (C- 
DEq  (C- 
DEq  (c- 
DEq  (c- 
DEq  (c-  1 
DDK  (C- 
DDK  (C-  ] 
DDK  (C-  ! 
DDK  (C-  1 
DBq  (C- 
DBq  (C- 
DEq  (c- 
DEq  (c- 
DDK  (C- 
DDK  (C- 
DDK  (C- 
DDK  (C- 
DEq  (C- 
DEq  (C- 
DEq  (c- 
DEq  (c- 
DEq  (c- 


;  Acceleration  initially  down 


;  V  down  from  the  perspective  X 
;  ‘C-*  means  covering  perspective 


;  A  down  from  the  perspective  X 
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(RC  TE  (0  1) 
(R C  TB  (0  1) 
(ac  TB  (0  1) 
(DURATION  (0 
(DISTAICE-BT 
(DISTAICE-BT 
(DISTAICE-BT 
(DISTAICE-BT 
(DISTAICE-BT 
(DISTAICE-BT 
(DISTAICE-BT 
(DISTAICE-BT 
(DISTAICE-BT 


DEQ  (C-  F)) 
DEQ  (C-  PE)) 
DEQ  (C-  KE)) 
1)  D0P) 

K  (0  1)  DEQ) 
PE  (0  1)  DEQ) 
F  (0  1)  DEQ) 

A  (0  1)  DDI) 

I  (0  1)  DEQ) 
TE  (0  1)  DEQ) 
KE  (0  1)  DEQ) 
V  (0  1)  DDI) 
W  (0  1)  DDN) 


Thus  it  takes  longer! 


;  X  moves  same  distance 


Tine:  1 

(ac 

(ac 

(ac 

(ac 

(ac 

(ac 

(ac 

(ac 

(ac 

(ac 

(ac 


v  1  DDI) 
X  1  DEQ) 
M  1  DOP) 
K  1  DEQ) 
F  1  DEQ) 
A  1  DEQ) 
PE  1  DEQ) 
T  1  DOP) 
VT  1  DDI) 
KE  1  DEQ) 
TE  1  DEQ) 


;  Maximum  velocity  is  loner 


;  Time  of  transition  is  bigger 
;  Although  T  squared  is  less . . 
;  Kinetic  energy  is  the  same 


One  can  ask  to  see  the  justification  for  any  proposition  in  the  database. 
Below  I  list  the  dependency  tree  for  the  assertion  that  it  takes  longer  for  the 
heavier  block  to  reach  rest  position.  Unlike  the  display  above,  here  I  show  all 
propositions  in  the  tree  regardless  of  their  importance.  The  subexpression 
‘(P-  X)1  means  that  the  parameter  X  is  a  partial  perspective. 

(DDKATIQI  (0  1)  DIP)  is  II  dus  to  DURATION -THE0REM1 : 

(0PP0SITE-RC  DDI  DUP)  is  II  because  it’s  a  PREMISE 
(DISTAICE-BT  X  (0  1)  DEQ)  is  II  due  to  DISTANCE: 

(SICI  X  (0  1)  -)  is  II  because  it's  a  PREMISE 
(RC  X  0  DEQ)  is  II  because  it’s  a  PREMISE 
(RC  X  1  DEQ)  is  II  due  to  ZERO-DOES-IOT-CHAIGE: 

(QMAG  X  1  0)  is  II  because  it's  a  PREMISE 
(TRAISITI0I-P0IIT  1)  is  II  because  it’s  a  PREMISE 
(RC  V  (0  1)  DDI  (P-  X))  is  II  due  to  DERIVATIVE-THEOREMl : 


(OTHER-RC  DDI  +  DDK)  is  IN  because  it's  a  PREMISE 
(OTHER-RC  DDI  +  DDE)  is  IN  ===already  sxplainsd=== 

(SIGN  V  (0  1)  +)  is  IN  because  it’s  a  PREMISE 
(SIGN  A  (0  1)  +)  is  IN  because  it’s  a  PREMISE 
(RC  A  (0  1)  DDN  CP-  X))  is  IN  due  to  MULT-INT-B: 

(MULT  M  A  F)  is  IN  because  it’s  a  PREMISE 

(RC  M  (0  1)  DOP  (P-  X))  is  IN  due  to  WEAKEN-PERSPECTIVE-RC-VALOES: 

(RC  M  (0  1)  DOP  (C-  X))  is  IN  due  to  INTERVAL-CONSTANT-THEOREM: 

(RC  M  0  DOP)  is  IN  because  it’s  a  PREMISE 

(QDIR  M  (0  1)  STD)  is  IN  because  it’s  a  PREMISE 

(PERSPECTIVE  (C-  X)  (0  1))  is  IN  due  to  COVERING-PERSPECTIVE-DEFN: 
(RC  I  0  DEQ)  is  IN  ===already  explained*** 

(RC  X  1  DEQ)  is  IN  ===already  explained=== 

(PERSPECTIVE  (P-  X)  (0  l))  is  IN  due  to  PARTIAL-PERSPECTIVE-DEFN1 : 

(QDIR  X  (0  1)  INC)  is  IN  because  it’s  a  PREMISE 
(RC  F  (0  1)  DEQ  (P-  X))  is  IN  due  to  KOLT-INT-C: 

(MOLT  X  K  F)  is  IN  because  it’s  a  PREMISE 

(RC  X  (0  1)  DEQ  (P-  X))  is  IN  due  to  WEAKEN-PERSPECTIVE-RC-VALOES : 

(RC  X  (0  1)  DEQ  (C-  X))  is  IN  due  to  SELF-REFERENCE: 

(PERSPECTIVE  (C-  X)  (0  i))  is  IN  ===already  explained*** 

(RC  K  (0  1)  DEQ  (P-  X))  is  IN  due  to  WEAKEN-PERSPECTIVE-RC-VALOES: 

(RC  K  (0  1)  DRq  (C-  X))  is  IN  due  to  INTERVAL-CONSTANT-THEOREM: 

(RC  K  0  DEQ)  is  IN  because  it’s  a  PREMISE 
(QDIR  K  (0  1)  STD)  is  IN  because  it’s  a  PREMISE 
(PERSPECTIVE  (C-  X)  (0  1))  is  IN  *==already  explained*** 

(SIGN  X  (0  1)  -)  is  IN  ===already  explained*** 

(SIGN  K  (0  1)  -)  is  IN  because  it's  a  PREMISE 
(RC  A  0  DDN)  is  IN  due  to  MOLT-POINT-B: 

(MOLT  K  A  F)  is  IN  ===already  explained*** 

(RC  M  0  DOP)  is  IN  ===already  explained*** 

(RC  F  0  DEq)  is  IN  due  to  MOLT-POINT-C : 

(MOLT  X  K  F)  is  IN  ===already  explained*** 

(RC  I  0  DEQ)  is  IN  ===already  explained*** 

(RC  K  0  DBQ)  is  IN  ===already  explained*** 

(RC  V  0  DEQ)  is  IN  because  it’s  a  PREMISE 
(RC  X  0  DEQ)  is  IN  ===already  explained*** 

(D//DT  V  A)  is  IN  because  it’s  a  PREMISE 
(D//DT  X  V)  is  IN  because  it’s  a  PREMISE 
(D//DT  X  V)  is  IN  ===already  explained*** 
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E.3  Exaggeration  Output 

Given  the  perturbation  Mf\0  the  transform  phase  of  exaggeration  creates  a 
new  state,  XS60,  to  encode  the  exaggerated  initial  conditions  (i.e.  infinite 
mass).  HR-QSIM  generates  four  possible  behaviors  one  of  which  is  shown 
below. 


State  XS60  persisting(O) ,  and  arriving  (NEG) : 


PE 

KE 

V? 

F 

A 

V 

X 


PEI 

0 

0 

F2 

(HALO  0  +) 
0 

X15 


(STD  0) 
(STD  0) 
(STD  0) 
(STD  0) 
(STD  0) 
(INC  IEG) 
(STD  0) 


State  XS61  persisting(INF  FIN  IEG),  and  arriving  (INF): 


PE 

KE 

VV 

F 

A 

V 

I 


(HALO  PEI  -) 
(HALO  0  +) 
(HALO  0  +) 
(HALO  F2  -) 


(HALO 

(HALO 


♦) 
+  ) 


(HALO  X1S  +) 


(DEC  IEG) 
(INC  IEG) 
(INC  IEG) 
(DEC  IEG) 
(DEC  IEG) 
(INC  IEG) 
(INC  IEG) 


State  XSS3  persis :^ng(INF) ,  and  arriving  (INF) 
pp  •  fn  pbiI  (nv.r.  ■Re') 


PF 

(0  PEI) 

(DEC 

IEG) 

KE 

(0  INF) 

(INC 

IEG) 

VV 

(HALO  0 

+  ) 

(INC 

IEG) 

F 

(0  F2) 

(DEC 

IEG) 

A 

(HALO  0 

+  ) 

(DEC 

IEG) 

V 

(HALO  0 

+  ) 

(INC 

IEG) 

X 

(X1S  0) 

(INC 

IEG) 

XS6S 

porsisting(INF  FIN 

IEG) 

PE 

(HALO  0 

+  ) 

(DEC 

IEG) 

KE 

(0  INF) 

(INC 

IEG) 

VV 

(HALO  0 

+  ) 

(INC 

IEG) 

F 

(HALO  0 

O 

(DEC 

IEG) 

A 

(HALO  0 

+  ) 

(DEC 

IEG) 

V 

(HALO  0 

+  ) 

(INC 

IEG) 

X 

(HALO  0 

-) 

(INC 

NEG) 
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State  XS67  persisting(O) ,  and  arriving  (NEG): 


PE 

0 

(STD 

0) 

KE 

KE1 

(STD 

0) 

TV 

(HALO  0 

+) 

(SfD 

0) 

F 

0 

(D.3C 

NEG) 

A 

0 

(DEC 

NEG) 

V 

(HALO  0 

+  ) 

(STD 

0) 

X 

0 

(INC 

NEG) 

State  XS69  persisting(INF  FIN),  and 


PE 

KE 

TV 

F 

1 

V 

X 


(HALO  0  +) 
(HALO  KE1  -) 
(HALO  0  +) 
(HALO  0  -) 
(HALO  0  -) 
(HALO  0  +) 
(HALO  0  +) 


(INC  NEG) 
(DEC  NEG) 
(DEC  NEG) 
(DEC  NEG) 
(DEC  NEG) 
(DEC  NEG) 
(INC  NEG) 


arriving  (INF) : 


State  XS71  persisting(INF) ,  and  arriving  (INF): 


PE 

(0  PEI) 

(INC 

NEG) 

KE 

(0  KE1) 

(DEC 

NEG) 

TV 

(HALO  0 

+  ) 

(DEC 

NEG) 

F 

(MINF  0) 

(DEC 

NEG) 

A 

(HALO  0 

-) 

(DEC 

NEG) 

V 

(HALO  0 

+) 

(DEC 

NEG) 

X 

(0  INF) 

(INC 

NEG) 

XS73 

persistingdNF  FIN 

NEG),  and 

PE 

(HALO  PEI  -) 

(INC  NEG) 

KE 

(HALO  0 

+  ) 

(DEC 

NEG) 

VV 

(HALO  0 

+  ) 

(DEC 

NEG) 

F 

(MINF  0) 

(DEC 

NEG) 

A 

(HALO  0 

-) 

(DEC 

NEG) 

V 

(HALO  0 

+  ) 

(DEC 

NEG) 

X 

(0  INF) 

(INC 

NEG) 

XS76 

persisting(O), 

and 

arriving 

PE 

PEI 

(STD 

0) 

KE 

0 

(STD 

0) 

VV 

0 

(STD 

0) 

F 

F3 

(STD 

0) 

A 

(HALO  0 

-) 

(STD 

0) 

V 

0 

(DEC 

NEG) 

X 

X1S 

(STD 

0) 
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State  ZS77  persisting(INF  FIN),  and  arriving  (INF): 


(HALO  PEI  -) 
(HALO  0  +) 


(HALO  0  +) 
(HALO  F3  +) 


(HALO  0  -) 
(HALO  0  -) 
(HALO  X16  -) 


(DEC  NEG) 
(INC  NEG) 
(INC  NEG) 
(INC  NEG) 
(INC  NEG) 
(DEC  NEG) 
(DEC  NEG) 


State  XS80  persisting(INF) ,  and  arriving  (INF): 


(0  PEI) 

(0  KE1) 
(HALO  0  +) 
(F3  0) 
(HALO  0  -) 
(HALO  0  -) 
(0  X16) 


(DEC  NEG) 
(INC  NEG) 
(INC  NEG) 
(INC  NEG) 
(INC  NEG) 
(DEC  NEG) 
(DEC  NEG) 


State  IS84  persisting(INF  FIN  NEG),  and  arriving  (INF  FIN  NEG): 


(HALO  0  +) 
(HALO  KE1  - 
(HALO  0  +) 
(HALO  0  -) 
(HALO  0  -) 
(HALO  0  -) 
(HALO  0  +) 


(DEC  NEG) 
(INC  NEG) 
(INC  NEG) 
(INC  NEG) 
(INC  NEG) 
(DEC  NEG) 
(DEC  NEG) 


State  XS88  persisting(O) ,  and  arriving  (NEG): 


0 

KE1 

(HALO  0  +) 
0 
0 

(HALO  0  -) 
0 


(STD  0) 
(STD  0) 
(STD  0) 
(INC  NEG) 
(INC  NEG) 
(STD  0) 
(DEC  NEG) 
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Appendix  F 

List  of  Examples  Implemented 

This  appendix  contains  a  list  of  examples  and  the  perturbations  I  used  to  test 
DQ  analysis  and  exaggeration.  I  start  with  a  brief  description  of  the  model, 
present  the  constaint  equations,  and  list  the  results  for  several  comparative 
analysis  questions.  I  state  only  whether  a  problem  was  solved  —  for  space 
and  time  reasons  the  generated  explanations  cannot  be  included. 

1.  Projectile 

This  is  the  simplest  model  of  a  projectile  fired  upwards  in  a  uniform 
gravitational  field.  I  tried  several  initial  conditions:  Y  =  0  and  Y  >  0. 

(constraints  ((d//dt  T  V)) 

((d//dt  T  G))) 

•  Increased  V: 

DQ  analysis  deduces  that  rise  time  increases. 

Exaggeration  deduces  that  rise  time  increases,  maximum  height 
increases,  and  fall  time  increases. 

•  Increased  G : 

DQ  analysis  deduces  that  rise  time  decreases. 

Exaggeration  deduces  that  rise  time  decreases,  maximum  height 
decreases,  and  fall  time  decreases. 


2.  Projectile  with  Mass 


(constraints  ((d//dt  T  V)) 
((d//dt  T  A)) 

((mult  M  A  F)) 

((mult  M  G  F))) 


•  Increased  V: 

DQ  analysis  deduces  that  rise  time  increases. 

Exaggeration  deduces  that  rise  time  increases,  maximum  height 
increases,  and  fall  time  increases. 

•  Increased  G: 

DQ  analysis  deduces  that  rise  time  decreases. 

Exaggeration  deduces  that  rise  time  decreases,  maximum  height 
decreases,  and  fall  time  decreases. 

•  Increased  M:  Neither  DQ  analysis  or  exaggeration  deduce  any¬ 
thing  interesting  due  to  ambiguous  qualitative  arithmetic. 

3.  Projectile  with  Mass  and  Energy  Conservation 
NPE  means  negative  potential  energy. 


(constraints  ((d//dt  T  V) ) 

((d//dt  ?  A)) 

((mult  v  y  yy)) 

((mult  M  yy  KE)) 

((mult  T  I  IPE)) 

((add  IPE  TE  KE)) 

((mult  M  A  F)) 

(.(*.  It  HOF))) 

•  Increased  V: 

DQ  analysis  deduces  that  rise  time  increases  and  maximum  height 
increases. 

Exaggeration  deduces  that  rise  time  increases,  maximum  height 
increases,  and  fall  time  increases. 


•  Increased  G : 

DQ  analysis  deduces  that  rise  time  decreases. 

Exaggeration  deduces  that  rise  time  decreases,  maximum  height 
decreases,  and  fall  time  decreases. 

•  Increased  M:  Neither  DQ  analysis  or  exaggeration  deduce  any¬ 
thing  interesting  due  to  ambiguous  qualitative  arithmetic. 

4.  Projectile  with  Decreasing  Gravity 

The  multiplication  constraint  says  that  A  =  y. 

(constraints  ((d//dt  T  V)) 

((d//dt  V  A)) 

((■ult  T  A  G))) 

•  Increased  V: 

DQ  analysis  deduces  nothing  of  interest. 

Exaggeration  deduces  that  rise  time  increases,  maximum  height 
increases,  and  fall  time  increases. 

•  Decreased  V: 

Exaggeration  deduces  that  rise  time  decreases,  maximum  height 
decreases,  and  fall  time  decreases. 

•  Increased  G : 

DQ  analysis  deduces  nothing  of  interest. 

Exaggeration  deduces  nothing  conclusively.  Simulation  is  quick 
but  ambiguous  —  for  example,  some  behaviors  take  negl  time  to 
apogee,  but  some  take  longer. 

•  Decreased  G: 

Exaggeration  deduces  that  rise  time  increases  and  maximum  height 
increases.  It  is  unable  to  unambiguously  conclude  that  fall  time 
increases . 

5.  Projectile  with  Decreasing  Gravity  and  Energy  Conservation 
(constraints  ((d//dt  T  V)) 
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((d//dt  V  A)) 

((wilt  V  ?  KE)) 

((■nit  T  A  HPE) ) 

((add  XPE  TE  KB)) 

((wilt  T  A  fi))) 

•  Increased  V : 

DQ  analysis  deduces  that  NPE  increases  at  apogee. 

Exaggeration  deduces  that  rise  time  increases  and  maximum  height 
increases. 

•  Increased  G: 

DQ  analysis  deduces  that  NPE  increases  at  apogee. 

Exaggeration  branches  intractably. 

6.  Simplest  Spring 

This  model  is  from  Kuipers’  library.  The  list  of  values  following  the 
monotonic  function  constraint  is  a  set  of  three  corresponding  values. 

(constraints  ((d//dt  I  V)) 

((d//dt  7  A)) 

((M-  A  I)  (0  0)  (mini  inf)  (inf  minf))) 

•  Increased  X : 

Neither  technique  deduces  anything.  In  fact,  no  answer  is  possible. 

7.  Ernie  Spring 

(constraints  ((d//dt  X  7)) 

((d//dt  V  A)) 

((wilt  K-ovar-K  X  A))) 

•  Increased  K-over-M: 

DQ  analysis  and  exaggeration  deduce  that  the  duration  (until  rest 
position)  decreases. 

•  Decreased  K-over-M: 

Exaggeration  deduces  that  duration  increases. 


8.  Standard  Spring 

As  with  most  of  the  spring  models,  this  was  tested  with  two  initial 
conditions  —  either  position  or  velocity  initially  zero.  The  results  listed 
here  are  for  initial  V  =  0  and  X  <  0. 

(constraints  ((d//dt  X  V)) 

((d//dt  V  A)) 

((milt  M  A  F)> 

((mult  X  K  F) ) ) 

•  Increased  M: 

DQ  analysis  and  exaggeration  deduce  that  the  duration  increases. 

•  Decreased  M: 

DQ  analysis  and  exaggeration  deduce  that  the  duration  decreases. 

•  Increased  K: 

DQ  analysis  and  exaggeration  deduce  that  the  duration  decreases. 

•  Decreased  K: 

DQ  analysis  and  exaggeration  deduces  that  the  duration  increases. 

•  Increased  K  and  decreased  M: 

DQ  analysis  deduces  that  the  duration  decreases. 

•  Decreased  K  and  increased  M: 

DQ  analysis  deduces  that  the  duration  increases. 

•  Increased  X: 

DQ  analysis  and  exaggeration  deduce  that  maximum  velocity  in- 


9.  Spring  with  Energy  Conservation 

(constraint*  ((d//dt  X  V)) 

((d//dt  V  A)) 

((mult  M  A  F)) 

((mult  X  K  F) ) 

((mult  V  V  VV)) 

((mult  TV  M  KE)) 

((mult  F  F  PE)) 

((add  PE  KE  TE))) 
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•  Increased  M: 

DQ  analysis  deduces  that  the  duration  of  ail  transition  intervals 
increase,  and  that  maximum  displacement  is  unchanged. 
Exaggeration  deduces  that  duration  increases.  With  a  50  state 
limit,  HR-QSIM  takes  47  seconds  to  generate  several  behaviors 
that  are  18  states  long. 

•  Increased  K : 

DQ  analysis  deduces  that  the  duration  until  first  transition  de¬ 
creases,  but  cannot  deduce  the  other  durations  because  total  en¬ 
ergy  and  thus  potential  energy  have  increased  making  it  impossible 
to  conclude  that  the  maximum  displacement  is  unch?nged. 
Exaggeration  branches  intractably. 

10.  Linear  Pendulum 

The  tests  were  done  with  initial  conditions  that  specified  dropping  the 
pendulum  from  an  elevated  position  with  zero  velocity. 

(constraints  ((d//dt  T  7)) 

((d//dt  7  A)) 

((mult  M  A  FT)) 

((mult  F  T  FT)) 

((mult  M  G  F))) 

•  Increased  M: 

Neither  technique  deduces  anything. 

•  Increased  G: 

DQ  analysis  and  exaggeration  deduce  that  the  fall  time  decreases. 

•  Decreased  G: 

Exaggeration  deduces  that  the  fall  time  increases. 

•  Increased  Y : 

DQ  analysis  deduces  nothing.  (This  run  was  done  with  transition 
derivative  rules  inactivated). 

•  Decreased  Y : 

Exaggeration  deduces  maximum  velocity  decreases. 


11.  Constant-Coolant  Heat  Exchanger 

Hot  oil  flows  through  a  pipe  with  velocity  V  losing  heat  to  a  constant 
temperature  coolant  surrounding  the  pipe.  Q  is  oil  heat  (indistinguish¬ 
able  from  temperature),  F  is  heat  flow,  K  is  the  thermal  conductivity 
of  the  pipe. 

(constraints  ((d//dt  Q  F)) 

C(d//dt  X  F)) 

((mult  K  Q  F))) 

•  Increased  V: 

DQ  analysis  and  exaggeration  deduce  that  the  oil  spends  less  time 
in  the  exchanger  and  that  the  oil  exits  with  more  heat. 

•  Decreased  V: 

Exaggeration  deduces  that  the  oil  exits  slower  and  cooler, 

•  Increased  K: 

DQ  analysis  and  exaggeration  deduce  that  the  oil  loses  more  heat. 
The  irrelevant-transition  filter  is  essential  for  exaggeration’s  suc¬ 
cess.  In  addition,  DQ  analysis  concludes  that  the  oil  will  spend 
the  same  time  in  the  exchanger. 

•  Decreased  K: 

Exaggeration  deduces  that  the  oil  loses  less  heat. 

•  Increased  X: 

DQ  analysis  and  exaggeration  deduce  that  more  time  is  spent  in 
the  exchanger  and  more  heat  is  lost. 

•  Decreased  X: 

Exaggeration  deduces  that  less  time  is  spent  and  less  heat  lost. 

12.  Warming-Coolant  Heat  Exchanger 

In  this  model,  the  coolant  warms  as  the  hot  oil  cools.  OQ  is  the  heat 
of  the  oil,  WQ  is  the  heat  of  the  coolant  water,  F  and  MF  are  heat 
flow  and  minus  heat  flow  respectively. 


(constraints  ((d//dt  OQ  F)) 

((minus  F  NF)) 

((d//dt  WQ  MF)) 

((d//dt  X  V)) 

((add  vg  oq  OQ)) 

((mult  K  DQ  F))) 

•  Increased  V : 

DQ  analysis  deduces  only  that  less  time  is  spent  in  the  exchanger. 
Exaggeration  deduces  that  less  time  is  spent,  output  oil  heat  is 
higher,  and  water  heat  is  lower. 

DQ  analysis  deduces  only  that  more  time  is  spent  in  the  exchanger. 

•  Increased  X: 

Exaggeration  deduces  that  more  time  is  spent  and  recognizes  that 
oil  and  water  reach  thermal  equilibrium,  but  is  unable  to  distin¬ 
guish  this  from  the  fin  heat  change  in  all  the  standard  behaviors. 

•  Decreased  X : 

Exaggeration  deduces  that  less  time  is  spent,  output  oil  heat  is 
higher,  and  water  heat  is  lower. 

•  Increased  K: 

DQ  analysis  deduces  that  duration  is  unchanged. 

Exaggeration  deduces  only  that  fin  heat  is  lost  in  negl  time,  but 
then  branches  intractably.  Five  initial  states  each  reached  a  50 
state  limit  producing  181  behaviors. 

•  Decreased  K: 

Exaggeration  had  no  problem.  One  five  state  behavior  produced. 
Deduced  that  less  heat  was  lost  by  the  oil  and  gained  by  the 
water.  (Unable  to  deduce  that  the  time  spent  in  the  exchanger 
was  unchanged.) 

13.  Walled  Heat  Exchanger 

In  this  model,  heat  flows  from  the  oil  to  the  pipe  wall  and  then  into  the 
water.  The  two  flows  have  separate  thermal  conductivity.  NET-FLOW 
is  the  sum  heat  flow  into  the  pipe  wall. 
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(constraints  ((d//dt  QQ  Fl)) 

((d//dt  WQ  MF2)) 

((d//dt  PQ  HET-FLOW)) 

((minus  Fl  MFl)) 

((minus  F2  MF2) ) 

((add  MFl  F2  HET-FLOW)) 

((add  PQ  DQ1  oq)) 

((add  wq  oq2  pq)) 

((mult  K1  Dqi  Fl)) 

((mult  K2  Dq2  F2)) 

((d//dt  IF))) 

•  Increased  V: 

DQ  analysis  deduces  that  duration  is  decreased. 

Exaggeration  deduces  that  duration  is  decreased,  output  oil  heat 
is  increased,  water  heat  is  decreased,  and  pipe  heat  is  decreased. 

•  Increased  Kl  and  increased  K2: 

DQ  analysis  deduces  that  duration  is  unchanged. 

Exaggeration  branches  intractably. 

•  Decreased  Kl  and  decreased  K2: 

Exaggeration  still  branches  intractably — with  a  500  state  limit 
HR-QSIM  generates  325  behaviors  that  are  9  states  long  and  X 
does  not  pass  -<x0)  0>-.  The  problem  is  that  NET-FLOW  can 
keep  changing  HR-QDIR. 

14.  Double  Flow  Heat  Exchanger 

This  is  a  modification  the  heat  exchanger  in  which  two  ‘substances’  are 
being  exchanged:  heat  ( Q )  and  danger  ( D ).  This  example  was  defined 
primarily  to  test  the  DQ  analysis  topological  code. 

(constraints  ((d//dt  q  F)) 

( (d//dt  X  V)) 

((mult  K  q  F)) 

( (d//dt  D  E)) 

((mult  C  D  E))) 

•  Increased  V: 

DQ  analysis  and  exaggeration  deduce  that  duration  is  decreased, 
output  heat  is  increased,  and  output  danger  is  increased. 
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15.  Super-Heated  Boiler 

This  is  a  rather  inaccurate  model  of  a  boiler  connected  to  a  steam 
superheater  in  series.  The  chief  question  is  what  happens  to  the  steam 
output  temperature  when  warmer  water  is  presented  to  the  boiler? 
DQ  analysis  correctly  answers  that  the  steam  will  cool  down  since  the 
boiling  rate  (Rb)  will  increase  causing  more  steam  to  compete  for  the 
superheater’s  heat.  See  [2]  for  a  better  model  of  this  system. 

The  list  (212  0  212)  is  a  set  of  corresponding  values  that  the  add  con¬ 
straint  must  obey. 

(constraints  ((add  Ti  deltaT  Tboil)  (212  0  212)) 

((mult  Rb  dsltaT  Fb)) 

((d//dt  X  Rb)) 

((d//dt  Ts  Fs)) 

•  Increased  Ti: 

DQ  analysis  deduces  that  the  boiling  rate  increases,  and  the  out¬ 
put  temperature  of  the  steam  decreases. 

16.  Two  Transitions 

This  model  was  used  to  test  the  DQ  analysis  topology  algorithm. 

(constraints  ((d//dt  A  0)) 

((d//dt  B  D))) 

17.  Three  Transitions 

This  model  was  used  to  test  the  DQ  analysis  topology  algorithm. 

(constraints  ((d//dt  A  DA)) 

( (d//dt  B  DB)) 

( (d//dt  C  DC))) 

18.  Fragmenting  Three 

This  model  was  used  to  test  the  DQ  analysis  topology  algorithm.  In 
one  behavior,  three  parameters  transition  at  once,  but  by  perturbing 
D,  they  can  be  forced  to  all  split  apart. 


(constraints  (Cd//dt  AO)) 

((d//dt  8  MO)) 

((d//dt  C  CD)) 

((mult  D  MO  OHE))) 

19.  Pumped  Containers 

See  section  4.3.2  for  a  discussion  of  this  model.  The  DQ  analysis  expla¬ 
nation  is  very  nice.  La  and  Lb  are  the  fluid  levels  of  containers  A  and 
B,  H  is  the  height  difference,  Fp  is  the  pumped  flow,  Fs  is  the  seeping 
flow,  and  Fn  is  the  net  flow. 

(constraints  ((minus  La  Lb)) 

((add  Lb  H  La)) 

((add  Fp  Fs  Fn)) 

((mult  H  PERMIABILITT  Fs)) 

((d//dt  La  Fn))) 

•  Increased  Fp: 

DQ  analysis  deduces  that  equilibrium  height  and  seeping  flow  are 
increased. 

Exaggeration  deduces  that  the  equilibrium  height,  level  in  A,  and 
seeping  flow  are  increased  while  the  level  in  B  is  decreased. 

•  Increased  PERMIABILITY: 

DQ  analysis  deduces  that  the  equilibrium  seeping  flow  is  unchanged 
(since  it  is  equal  to  pumped  flow)  thus  height  is  decreased. 
Exaggeration  deduces  that  height  and  the  level  in  A  are  decreased 
while  the  level  in  B  is  increased. 

20.  Series  RC  Circuit 

Close  a  circuit  to  charge  a  capacitor  hooked  in  series  with  a  resistor. 

(constraints  ((D//dt  Vc  dVc)) 

((add  Vr  Vc  V)) 

((mult  R  I  Vr)) 

((mult  C  dVc  I))) 


•  Increased  C : 

DQ  analysis  and  exaggeration  deduce  that  it  takes  longer  to  charge 
the  capacitor. 

•  Increased  R: 

DQ  analysis  and  exaggeration  deduce  that  it  takes  longer  because 
the  current  is  smaller. 

•  Increased  V : 

DQ  analysis  and  exaggeration  deduce  nothing  of  great  interest. 

21.  Parallel  RC  Circuit 

See  [50,  p350]  for  a  description  of  this  circuit. 

(constraints  ((mult  R  Ir  V)) 

((minus  Ir  Ic)) 

((D//dt  V  dv)) 

((mult  dV  C  Ic))) 

•  Increase  R: 

DQ  analysis  and  exaggeration  deduce  that  it  takes  longer  for  the 
capacitor  to  discharge. 

•  Increase  V: 

Neither  technique  deduces  anything  interesting. 

•  Increase  C: 

DQ  analysis  and  exaggeration  deduce  that  it  takes  longer  for  the 
capacitor  to  discharge. 

22.  Two  RC  Series  Circuits  in  Parallel 

(constraints  ((D//dt  Vcl  dVcl)) 

((D//dt  Vc2  dVc2) ) 

((add  Vrl  Vcl  V)) 

((add  Vr2  Vc2  V)) 

( (mult  R1  II  Vrl)) 

((mult  R2  12  Vr2) ) 

((mult  Cl  dVcl  II)) 

((mult  C2  dVc2  12)) 

((add  II  12  I))) 
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